-- Logs begin at Mon 2022-10-24 13:00:37 UTC, end at Mon 2022-10-24 14:05:32 UTC. -- Oct 24 13:33:16.371905 dv-cinder-862490-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 13:33:16.380785 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:33:16 2022] *** Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: nodename: dv-cinder-862490-2-iscsi Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: machine: x86_64 Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: clock source: unix Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: pcre jit disabled Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: detected number of CPU cores: 4 Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: current working directory: / Oct 24 13:33:16.382803 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: your processes number limit is 47680 Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: your memory page size is 4096 bytes Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: detected max file descriptor number: 2048 Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: lock engine: pthread robust mutexes Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: thunder lock: enabled Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 13:33:16.383502 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:33:16.423568 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: Python main interpreter initialized at 0x55a7aabd39c0 Oct 24 13:33:16.423568 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: python threads support enabled Oct 24 13:33:16.423568 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: your server socket listen backlog is limited to 100 connections Oct 24 13:33:16.423568 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:33:16.423919 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:33:16.424003 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: *** Operational MODE: preforking *** Oct 24 13:33:16.424235 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:33:16.424235 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: spawned uWSGI master process (pid: 110424) Oct 24 13:33:16.424410 dv-cinder-862490-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 24 13:33:16.425484 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: spawned uWSGI worker 1 (pid: 110425, cores: 1) Oct 24 13:33:16.425484 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: spawned uWSGI worker 2 (pid: 110426, cores: 1) Oct 24 13:33:16.425484 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:33:17.088355 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:33:17.088964 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:33:18.158758 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:33:18.158758 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: from cryptography.utils import int_from_bytes Oct 24 13:33:18.159450 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:33:18.159450 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: from cryptography.utils import int_from_bytes Oct 24 13:33:18.162678 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:33:18.162678 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: from cryptography.utils import int_from_bytes Oct 24 13:33:18.163126 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:33:18.163126 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: from cryptography.utils import int_from_bytes Oct 24 13:33:20.644487 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:33:20.645056 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:33:20.645251 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:33:20.645604 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:33:20.645851 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:33:20.646252 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.646575 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.646888 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.647199 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.647520 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.647818 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.648135 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.648444 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.648761 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.648960 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:33:20.649320 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.649399 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:33:20.649482 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.649613 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862490-2-iscsi {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.649741 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:33:20.649926 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.650093 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:33:20.650248 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.650370 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:33:20.650551 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.650747 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.650860 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.651066 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.651150 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.651378 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.651462 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.651796 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.651893 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.652043 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.652213 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.652334 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.652627 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.652739 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.652932 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653040 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653234 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653374 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653479 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653582 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653784 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.653883 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.654098 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862490-2-iscsi {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.654225 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.654439 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.654525 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.654739 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.654823 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655041 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655140 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655344 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655435 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655640 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655733 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862490-2-iscsi {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.655954 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.656045 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.656252 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.656337 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.656627 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.656907 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.657059 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.657318 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.657456 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.657614 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.657757 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.657926 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658034 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658264 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658364 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658562 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658652 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658878 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.658964 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.659187 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.659272 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.659496 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.659593 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.659807 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.659900 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.660101 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.660187 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.660399 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.660491 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862490-2-iscsi {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.660699 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.660790 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661008 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661110 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661304 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661434 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661600 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661744 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.661873 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.662051 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.662136 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.662376 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.662477 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.662691 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.662778 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663018 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663103 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663291 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663377 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663533 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663618 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663848 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.663999 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.664401 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.664504 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.664714 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.664815 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665013 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665110 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665312 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665404 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665609 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665701 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.665905 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666005 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666221 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666311 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666521 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666629 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666779 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.666873 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667080 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667165 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667392 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667525 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667702 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667788 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.667997 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668083 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668251 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668354 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668515 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668685 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668782 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.668930 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669090 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669396 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669558 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669695 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669868 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.669994 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.670188 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.670315 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.670500 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.670601 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.670813 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.670899 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.671112 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.671198 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.671409 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.671493 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.671707 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.671801 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672018 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672176 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672363 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672566 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672655 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672895 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.672989 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.673189 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.673273 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.673486 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.673646 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.673797 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.673917 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.674094 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.674201 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.674429 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.674528 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.674728 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.674821 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675022 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675107 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675321 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675408 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675620 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675707 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.675917 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676003 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676215 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676328 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676511 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676630 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676808 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.676943 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677104 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677271 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677403 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677573 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677698 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677820 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.677992 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.678123 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.678344 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.678490 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.678637 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.678747 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.678934 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679029 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679232 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679326 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679615 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679826 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.679920 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.680137 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.680223 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.680433 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.680518 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.680729 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.680824 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681040 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681126 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681337 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681428 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681631 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681723 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.681925 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682008 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682244 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682332 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682542 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682835 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.682919 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.683133 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.683217 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.683432 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.683518 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.683727 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.683811 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684023 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684117 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684319 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684413 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684612 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684696 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684908 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.684993 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.685202 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.685292 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.685495 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.685578 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.685787 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.685961 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.686119 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.686234 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.686446 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.686532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.686756 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.686842 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.687067 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.687152 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.687362 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.687453 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.688172 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.688316 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.688600 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.688690 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.688921 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.689151 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.689239 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.689470 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.689565 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.689781 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.689888 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.690084 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.690217 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.690411 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.690548 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.690713 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.690873 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.691015 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.691187 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.691315 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.691492 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.691614 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.691796 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.691912 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.692114 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.692246 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.692416 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.692509 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.692718 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.692803 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.693019 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.693118 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.693326 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.693413 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.693634 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.693719 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.693954 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.694051 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:33:20.694285 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.694376 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.694594 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.694680 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.694908 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.694995 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.695210 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.695295 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.695519 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.695684 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.695840 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.695947 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.696149 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.696235 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.696450 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.696534 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.696755 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.696841 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697074 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697168 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697380 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697475 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697683 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697776 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.697986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.698071 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.698317 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.698458 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.698619 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.698706 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.698924 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699019 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699234 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699329 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699542 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699628 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699845 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.699930 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.700147 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.700242 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.700449 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.700537 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.700763 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.700856 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701067 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701155 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701368 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701452 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701668 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701759 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.701971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.702057 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.702347 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.702448 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.702615 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.702703 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.702921 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.703016 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.703235 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.703411 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.704201 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.704298 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.704493 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.704753 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.704839 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705098 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705184 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705399 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705485 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705700 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705786 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.705998 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.706084 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.706320 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.706420 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.706618 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.706705 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.706919 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707007 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707215 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707303 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707526 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707614 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707832 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.707917 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.708132 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.708219 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.708455 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.708597 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.708756 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.708842 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709061 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709149 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709363 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709450 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709664 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709764 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.709961 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710047 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710292 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710391 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710594 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710691 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710891 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.710976 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.711188 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.711274 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.711488 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.711584 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.711783 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.711878 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712228 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712385 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712515 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712686 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712795 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.712990 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713079 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713295 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713384 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713597 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713682 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713900 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.713986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.714221 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.714325 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.714540 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.714628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.714850 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.714937 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.715149 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.715243 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.715454 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.715540 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.715757 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.715850 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716053 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716150 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716368 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716453 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716671 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716764 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.716968 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717054 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717266 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717350 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717567 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717668 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717861 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.717946 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.718157 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.718266 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.718476 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.718645 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.718777 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.718908 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.719097 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.719182 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.719394 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.719674 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.719762 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.719975 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720059 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720273 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720371 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720585 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720672 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720887 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.720973 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.721183 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.721277 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.721479 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.721572 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.721774 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.721860 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.722108 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.722377 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.722486 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.722568 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.722740 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.722838 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723041 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723137 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723340 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723426 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723639 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723725 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.723938 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724024 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724240 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724325 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724537 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724623 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724835 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.724929 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.725131 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.725217 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.725430 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.725515 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.725729 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.725815 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726030 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726122 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726358 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726445 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726656 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726744 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.726954 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.727048 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.727252 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.727346 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.727561 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.727653 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.727859 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728001 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728167 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728263 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728497 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728591 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728814 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.728898 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.729121 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.729222 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.729426 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.729510 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.729728 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.729813 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730035 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730136 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730364 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730450 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730704 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730808 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.730968 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731063 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731271 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731357 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731572 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731663 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731873 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.731958 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.732175 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.732261 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.732475 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.732560 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.732791 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.732901 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733104 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733204 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733390 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733474 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733687 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733773 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.733993 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.734085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.734335 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.734437 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.734690 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.734776 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.735090 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.735267 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.735397 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.735668 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.735755 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.735982 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736068 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736289 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736375 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736590 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736676 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736889 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.736980 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.737189 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.737277 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.737490 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.737577 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.737796 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.737881 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.738102 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.738205 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.738432 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.738519 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.738728 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.738808 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739035 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739174 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739336 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739422 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739632 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739716 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.739926 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740019 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740316 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740548 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740641 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740852 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.740946 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.741154 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.741245 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.741468 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.741553 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.741765 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.741862 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742061 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742155 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742385 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742471 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742687 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742782 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.742985 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743281 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743371 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743578 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743665 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743880 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.743974 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.744182 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.744267 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.744480 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.744574 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.744788 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.744874 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745092 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745390 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745482 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745688 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745773 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.745989 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.746075 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.746316 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.746406 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.746618 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.746706 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.746927 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747093 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747231 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747316 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747530 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747616 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747830 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.747932 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.748131 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.748216 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.748432 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.748525 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.748727 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.748824 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749025 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749110 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749323 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749412 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749626 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749719 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.749924 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.750011 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.750760 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.750902 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.751051 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.751388 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.751612 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.751821 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.751940 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.752134 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.752251 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.752449 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.752562 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.752759 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.752903 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.753069 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.753201 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.753388 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.753531 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.753697 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.753854 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754003 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754172 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754337 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754482 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754644 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754786 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.754948 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755083 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755253 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755388 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755570 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755692 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755873 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.755990 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.756180 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.756287 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.756485 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.756570 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.756783 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.756878 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.757086 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.757172 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.757397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.757484 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.757726 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.757952 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.758040 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.758304 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.758393 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.758616 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.758702 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.758923 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759011 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759222 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759358 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759537 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759634 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759841 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.759937 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.760138 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.760224 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.760434 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.760521 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.760731 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.760826 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761066 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761150 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761364 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761449 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761660 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761746 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.761964 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762050 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762295 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762383 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762593 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762681 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762894 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.762979 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.763202 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.763329 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.763505 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.763607 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.763800 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.763905 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764095 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764192 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764393 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764490 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764692 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764796 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.764990 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.765097 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.765292 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.765388 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.765590 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.765687 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766000 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766118 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766292 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766570 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766676 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766874 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.766972 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.767170 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.767266 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.767468 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.767565 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.767767 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.767863 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768064 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768162 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768361 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768458 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768665 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768778 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.768967 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769070 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769263 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769377 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769567 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769682 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769864 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.769951 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.770185 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.770287 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.770492 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.770592 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.770792 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.770877 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771089 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771181 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771388 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771475 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771685 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771771 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.771980 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772065 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772279 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772371 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772580 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772665 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772876 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.772960 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.773168 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.773268 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.773471 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.773575 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.773764 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.773859 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774060 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774157 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774382 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774478 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774676 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774773 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.774971 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775069 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775274 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775370 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775574 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775678 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775869 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.775964 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.776165 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.776262 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.776459 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.776567 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.776759 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.776855 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777054 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777152 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777347 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777456 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777642 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777737 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.777937 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778032 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778255 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778366 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778552 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778648 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778860 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.778955 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.779156 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.779253 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.779451 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.779545 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.779744 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.779845 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780043 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780129 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780346 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780433 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780643 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780728 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.780945 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.781031 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.781260 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.781346 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.782092 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.782214 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.782438 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.782669 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.782842 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.782986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.783154 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.783290 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.783469 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.783630 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.783768 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.783881 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784073 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784168 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784381 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784468 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784681 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784769 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.784982 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.785076 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.785299 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.785386 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.785609 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.785696 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.785917 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786012 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786241 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786332 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786543 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786629 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786843 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.786931 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.787140 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.787225 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.787446 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.787530 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.787749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.787844 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788052 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788138 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788358 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788470 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788661 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788759 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.788963 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.789061 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.789539 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.789639 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.789842 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.789944 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.790142 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.790249 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.790469 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.790572 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.790767 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.790860 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791068 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791173 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791370 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791470 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791707 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791802 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.791983 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792073 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792268 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792378 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792566 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792653 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792866 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.792953 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.793161 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.793261 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.793461 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.793548 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.793758 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.793857 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.794075 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.794188 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.794403 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.794501 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.794709 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.794796 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795012 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795109 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795317 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795404 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795620 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795706 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.795923 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796011 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796226 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796311 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796522 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796616 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796824 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.796932 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.797823 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.797926 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.798323 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.798512 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.798775 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.798860 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.799092 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.799177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.799399 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.799495 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.799707 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.799804 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800021 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800106 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800320 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800415 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800620 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800705 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.800917 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801003 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801222 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801381 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801518 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801603 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801831 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.801918 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.802258 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.802347 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.802555 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.802641 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.802853 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.802945 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.803159 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.803253 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.803464 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.803551 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.803821 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.803920 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.804081 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.804168 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.804384 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.804469 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.804743 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.804827 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805040 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805127 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805345 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805430 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805647 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805746 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.805949 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806035 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806269 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806359 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806573 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806670 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806878 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.806970 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.807174 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.807284 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.807472 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.807559 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.807772 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.807871 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.808081 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.808179 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.808377 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.808463 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.808690 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.808792 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.809088 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.809173 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.809388 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.809473 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.809702 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.809851 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810003 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810090 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810326 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810414 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810626 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810714 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.810928 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811015 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811225 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811311 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811524 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811612 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811840 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.811935 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.812139 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.812225 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.812445 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.812539 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.812823 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.812969 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.813284 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.813471 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.813588 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.813836 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.813946 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.814157 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.814298 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.814483 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.814572 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.814804 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.814891 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.815112 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.815197 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.815425 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.815512 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.815738 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.815824 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816044 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816131 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816359 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816447 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816661 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816749 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.816959 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817053 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817258 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817353 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817554 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817644 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817887 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.817987 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.818206 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.818297 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.818523 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.818654 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.818821 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.818920 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.819138 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.819226 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.819438 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.819532 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.819746 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.819841 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820051 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820174 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820353 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820441 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820653 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820748 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.820957 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821043 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821273 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821359 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821572 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821659 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821870 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.821956 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.822182 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.822270 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.822494 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.822590 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.822792 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.822879 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823088 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823174 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823390 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823479 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823687 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823773 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.823984 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824070 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824278 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824376 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824570 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824655 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824875 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.824970 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.825186 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.825273 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.825489 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.825589 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.825785 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.825881 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.826086 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.826192 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.826404 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.826490 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.826738 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.826837 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827036 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827122 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827354 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827440 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827655 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827750 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.827961 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.828084 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.828267 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.828372 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.828614 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.828745 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.828923 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.829233 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.829331 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.829537 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.829633 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.829836 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.829923 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.830138 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.830299 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.830460 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.830561 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.830766 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.830887 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831068 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831153 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831367 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831462 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831665 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831876 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.831964 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.832203 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.832298 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.832515 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.832610 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.832825 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.832912 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.833134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.833229 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.833428 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.833514 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.833725 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.833823 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834032 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834132 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834365 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834464 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834670 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834757 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.834971 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835071 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835304 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835394 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835598 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835683 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835908 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.835997 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.836216 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.836301 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.836521 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.836614 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.836827 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.836914 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.837137 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.837226 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.837443 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.837528 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.837765 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.837866 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.838073 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.838226 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.838399 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.838496 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.838705 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.838833 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839014 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839219 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839307 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839638 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839858 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.839945 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.840167 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.840254 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.840474 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.840571 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.840784 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.840876 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.841088 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.841183 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.841392 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.841478 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.841697 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.841789 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842000 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842095 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842327 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842416 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842650 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842736 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.842956 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.843051 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.843265 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.843351 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.843575 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.843661 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.843892 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.844591 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.844894 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845004 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845221 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845324 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845538 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845629 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845853 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.845966 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.846187 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.846291 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.846501 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.846589 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.846820 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.846907 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.847121 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.847216 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.847420 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.847506 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.847723 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.847809 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848025 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848120 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848323 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848410 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848638 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848732 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.848939 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849036 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849236 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849322 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849540 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849626 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849841 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.849927 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.850156 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.850385 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.850504 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.850723 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.850824 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851033 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851120 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851349 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851436 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851668 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851764 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.851980 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.852197 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.852287 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.852508 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.852603 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.852835 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.852946 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.853155 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.853249 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.853461 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.853555 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.853769 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.853863 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.854068 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.854234 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.854393 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.854494 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.854700 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.854786 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855001 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855089 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855300 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855400 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855601 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855692 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855901 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.855987 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.856226 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.856313 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.856526 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.856613 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.856826 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.856912 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.857124 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.857219 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.857424 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.857509 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.857719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.857945 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.858041 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.858311 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.858444 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.858615 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.858701 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.858921 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.859021 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.859220 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.859314 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.859524 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.860171 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.860422 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.860537 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.860727 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861024 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861112 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861338 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861444 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861643 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861731 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.861957 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862051 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862284 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862386 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862585 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862672 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862883 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.862976 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.863188 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.863283 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.863489 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.863575 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.863789 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.863876 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.864089 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.864176 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.864387 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.864472 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.864708 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.864801 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865008 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865233 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865320 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865561 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865647 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865876 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.865971 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.866198 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.866288 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.866494 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.866583 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.866796 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.866892 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867095 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867181 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867400 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867487 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867697 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867785 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.867999 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868086 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868297 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868383 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868597 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868686 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868900 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.868986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.869203 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.869506 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.869594 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.869808 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.869896 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.870104 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.870289 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.870427 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.870516 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.870727 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.870821 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871026 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871125 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871326 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871413 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871628 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871715 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.871929 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.872029 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.872235 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.872323 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.872564 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.872649 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.872870 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.873089 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.873177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.873415 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.873503 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.873731 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.873827 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874052 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874137 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874379 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874471 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874681 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874778 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.874978 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.875063 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.875301 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.875435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.875623 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.875889 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.875978 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.876221 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.876305 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.876586 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.876873 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.876961 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.877185 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.877271 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.877488 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.877581 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.877794 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.877890 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.878097 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.878202 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.878428 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.878514 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.878731 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.878819 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879033 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879164 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879334 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879637 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879723 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.879935 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880029 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880236 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880333 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880543 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880631 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880876 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.880962 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.881177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.881271 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.881477 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.881564 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.881774 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.881861 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.882079 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.882221 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.882411 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.882509 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.882714 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.882800 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883013 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883100 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883313 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883406 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883614 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883699 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883911 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.883999 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.884211 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.884297 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.884508 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.884593 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.884804 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885107 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885193 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885404 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885491 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885703 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885791 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.885999 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.886086 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.886332 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.886421 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.886638 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.886755 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.886938 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887032 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887241 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887335 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887540 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887636 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887836 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.887925 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.888133 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.888231 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.888430 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.888519 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.888726 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.888812 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889051 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889146 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889377 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889475 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889677 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889763 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.889976 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.890073 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.890307 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.890408 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.890622 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.890709 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.890951 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.891050 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.891366 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.891509 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.891788 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.891907 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.892110 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.892219 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.892417 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.892525 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.892741 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.892835 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893047 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893134 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893353 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893440 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893661 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893748 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.893967 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894054 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894292 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894381 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894639 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894732 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894895 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.894990 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.895194 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.895281 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.895493 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.895635 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.895796 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.895884 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896095 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896182 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896396 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896492 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896694 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896781 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.896993 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.897079 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.897290 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.897385 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.897602 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.897688 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.897905 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898000 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898227 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898318 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898534 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898630 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898837 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.898924 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.899144 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.899232 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.899445 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.899540 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.899746 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.899832 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900054 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900142 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900360 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900448 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900661 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900783 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.900986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901075 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901286 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901371 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901589 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901684 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901895 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.901982 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.902223 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.902313 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.902529 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.902627 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.902832 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.902919 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.903154 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.903241 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.903475 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.903570 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.903774 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.903860 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.904069 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.904155 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.904306 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:33:20.904394 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.904693 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.905002 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.905309 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.905632 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.905938 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.906270 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.907191 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.907741 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.908106 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.908425 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.908736 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.909046 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.909359 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.909673 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.909997 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.910349 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.910658 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.910979 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.911300 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.911641 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.911956 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.912294 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.912620 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.912929 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.913235 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.913535 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:33:20.913774 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:33:21.058812 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO dbcounter [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Registered counter for database nova_api Oct 24 13:33:21.070027 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO dbcounter [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Registered counter for database nova_api Oct 24 13:33:21.079747 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_db.sqlalchemy.engines [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.086465 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writer thread running {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.090412 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_db.sqlalchemy.engines [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.097746 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writer thread running {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.147022 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.context [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1e20d1c-cda7-4a62-9810-539755b5196c(cell1) {{(pid=110425) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:33:21.150816 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:21.151283 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:21.152872 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:21.153568 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:21.154004 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:21.155056 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.context [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1e20d1c-cda7-4a62-9810-539755b5196c(cell1) {{(pid=110426) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:33:21.156029 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:21.158632 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO dbcounter [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Registered counter for database nova_cell0 Oct 24 13:33:21.159750 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_concurrency.lockutils [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:21.160213 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_concurrency.lockutils [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:21.161806 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_concurrency.lockutils [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:21.162535 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_concurrency.lockutils [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:33:21.162687 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO dbcounter [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Registered counter for database nova_cell1 Oct 24 13:33:21.162971 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_concurrency.lockutils [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:33:21.165216 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_concurrency.lockutils [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:33:21.167372 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO dbcounter [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Registered counter for database nova_cell0 Oct 24 13:33:21.169908 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_db.sqlalchemy.engines [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.171461 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO dbcounter [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Registered counter for database nova_cell1 Oct 24 13:33:21.171580 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_db.sqlalchemy.engines [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.177489 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writer thread running {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.179796 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writer thread running {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.183116 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_db.sqlalchemy.engines [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.184314 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_db.sqlalchemy.engines [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.191033 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writer thread running {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.192647 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writer thread running {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.324933 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO dbcounter [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Registered counter for database nova_cell0 Oct 24 13:33:21.334579 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_db.sqlalchemy.engines [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.339331 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writer thread running {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.342235 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO dbcounter [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Registered counter for database nova_cell0 Oct 24 13:33:21.349184 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG oslo_db.sqlalchemy.engines [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:33:21.353835 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writer thread running {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:33:21.676130 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: WARNING keystonemiddleware.auth_token [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:33:21.683377 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: WARNING keystonemiddleware.auth_token [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:33:21.689936 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: WARNING keystonemiddleware.auth_token [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:33:21.697179 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: WARNING keystonemiddleware.auth_token [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:33:22.025672 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: WARNING keystonemiddleware.auth_token [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:33:22.032162 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: WARNING keystonemiddleware.auth_token [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:33:22.037506 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7aabd39c0 pid: 110425 (default app) Oct 24 13:33:22.039844 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:33:22.041013 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001969 Oct 24 13:33:22.041425 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Oct 24 13:33:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:33:22.048239 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: WARNING keystonemiddleware.auth_token [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:33:22.054243 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: WARNING keystonemiddleware.auth_token [None req-70f12c04-f72f-4f3a-a8a4-dad93a99f5cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:33:22.059728 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7aabd39c0 pid: 110426 (default app) Oct 24 13:34:44.010480 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.012118 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Oct 24 13:34:44.012701 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:44.024630 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_api:SELECT=3 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:44.025753 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_cell0:SELECT=3 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:44.026617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_cell1:SELECT=3 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:44.028842 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:44.934895 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-8ee77905-551d-425a-b16b-9dedbddc033b admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:44.970503 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-8ee77905-551d-425a-b16b-9dedbddc033b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.950856 Oct 24 13:34:44.971379 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 24 13:34:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:47.589116 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:47.590089 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-a97a0ec1-1699-457f-8ba3-63fb9049d204 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Oct 24 13:34:47.590707 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:48.060397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-b761709c-38c0-4dcd-a5eb-3ce07a8fc338 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "swap": 0}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:48.107188 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-b761709c-38c0-4dcd-a5eb-3ce07a8fc338 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510037 Oct 24 13:34:48.108278 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:34:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:34:48.122261 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_api:SELECT=3 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:48.123151 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_cell0:SELECT=3 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:48.126109 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_cell1:SELECT=3 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:48.128125 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:34:48.335096 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-a61c5c89-b0c9-46d8-8e00-9d59efcf4b3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:48.407280 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-a61c5c89-b0c9-46d8-8e00-9d59efcf4b3f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290277 Oct 24 13:34:48.408046 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 24 13:34:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:51.031519 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-b761709c-38c0-4dcd-a5eb-3ce07a8fc338 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:51.032446 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-b761709c-38c0-4dcd-a5eb-3ce07a8fc338 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 24 13:34:51.032853 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:51.682328 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-9249f79e-2bd8-4fef-a3fb-c929ac7986ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:51.724687 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-9249f79e-2bd8-4fef-a3fb-c929ac7986ea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.685611 Oct 24 13:34:51.725417 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:34:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:34:51.737331 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-52786910-778f-4019-9047-36a08866c612 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:51.775099 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-52786910-778f-4019-9047-36a08866c612 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041336 Oct 24 13:34:51.786681 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 24 13:34:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:54.394335 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-9249f79e-2bd8-4fef-a3fb-c929ac7986ea admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:54.395427 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-9249f79e-2bd8-4fef-a3fb-c929ac7986ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Oct 24 13:34:54.395951 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:54.818677 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-14f7142b-bc54-4627-a800-a2f60ffb1d23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:54.839969 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-14f7142b-bc54-4627-a800-a2f60ffb1d23 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437161 Oct 24 13:34:54.840544 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:34:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:34:54.852480 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-67164afd-ceb7-4ce7-9ac4-b5e002f6456a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:54.880567 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-67164afd-ceb7-4ce7-9ac4-b5e002f6456a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031662 Oct 24 13:34:54.881143 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 24 13:34:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:34:57.530752 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-14f7142b-bc54-4627-a800-a2f60ffb1d23 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:34:57.531707 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-14f7142b-bc54-4627-a800-a2f60ffb1d23 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Oct 24 13:34:57.532104 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:34:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:34:57.956352 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-0152a9ca-7a31-46df-bf52-9161232f8afd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:57.982096 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-0152a9ca-7a31-46df-bf52-9161232f8afd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443993 Oct 24 13:34:57.983941 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:34:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:34:57.995567 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-f2062108-99a0-45b2-abda-a4f4d9f68be6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:34:58.024434 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-f2062108-99a0-45b2-abda-a4f4d9f68be6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032755 Oct 24 13:34:58.025476 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 24 13:34:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:00.724738 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-0152a9ca-7a31-46df-bf52-9161232f8afd admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:00.726082 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-0152a9ca-7a31-46df-bf52-9161232f8afd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Oct 24 13:35:00.726677 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:01.212840 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-74e263b0-59c2-44ea-b999-288f31a4c76c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "disk": 20, "ram": 4096, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:01.237773 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-74e263b0-59c2-44ea-b999-288f31a4c76c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504734 Oct 24 13:35:01.238816 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:35:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:01.254371 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-53fbac73-7753-4f66-8469-0901eff6d812 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:01.281304 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-53fbac73-7753-4f66-8469-0901eff6d812 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031929 Oct 24 13:35:01.281911 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 24 13:35:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:04.032855 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-74e263b0-59c2-44ea-b999-288f31a4c76c admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:04.034192 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-74e263b0-59c2-44ea-b999-288f31a4c76c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Oct 24 13:35:04.034753 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:35:04.483701 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-6ff6b4af-5a1a-4f0f-b525-91c9b562f2c9 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:04.515513 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-6ff6b4af-5a1a-4f0f-b525-91c9b562f2c9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473957 Oct 24 13:35:04.516194 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 24 13:35:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:07.131335 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-74e263b0-59c2-44ea-b999-288f31a4c76c admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:07.132495 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-74e263b0-59c2-44ea-b999-288f31a4c76c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 24 13:35:07.132905 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:35:07.530261 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-af66fd3d-96fa-427e-ac76-f6c0d8a3e230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:07.551017 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-af66fd3d-96fa-427e-ac76-f6c0d8a3e230 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411993 Oct 24 13:35:07.551669 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:35:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:07.563706 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-876d11df-1dcb-4c58-b8af-479a81c2ae6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:07.590335 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-876d11df-1dcb-4c58-b8af-479a81c2ae6d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030227 Oct 24 13:35:07.590899 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 24 13:35:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:10.194698 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-af66fd3d-96fa-427e-ac76-f6c0d8a3e230 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:10.196343 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-af66fd3d-96fa-427e-ac76-f6c0d8a3e230 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Oct 24 13:35:10.196746 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:10.577840 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-9bfc782e-97fa-476a-b7b3-9e50e15171eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "disk": 20}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:10.596687 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-9bfc782e-97fa-476a-b7b3-9e50e15171eb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.393538 Oct 24 13:35:10.597240 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:35:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:10.610382 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-b7abf2be-4a33-4092-a110-7ba0a52b8524 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:10.633826 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-b7abf2be-4a33-4092-a110-7ba0a52b8524 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028231 Oct 24 13:35:10.634426 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 24 13:35:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:13.323194 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-9bfc782e-97fa-476a-b7b3-9e50e15171eb admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:13.324209 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-9bfc782e-97fa-476a-b7b3-9e50e15171eb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 24 13:35:13.324615 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:13.776475 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-2da75504-06c5-4547-b5a3-aa0f544e90d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "name": "m1.medium", "disk": 40}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:13.799313 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-2da75504-06c5-4547-b5a3-aa0f544e90d3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.467966 Oct 24 13:35:13.800504 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:35:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:13.814241 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-048e15c3-53e7-42b5-bb4a-986db7ec9bf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:13.842205 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-048e15c3-53e7-42b5-bb4a-986db7ec9bf1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032817 Oct 24 13:35:13.842787 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 24 13:35:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:35:16.498089 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-2da75504-06c5-4547-b5a3-aa0f544e90d3 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:16.499113 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-2da75504-06c5-4547-b5a3-aa0f544e90d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Oct 24 13:35:16.499524 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:16.928102 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-b84f7878-c3f6-4634-95ee-ccae54ea0729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "vcpus": 4}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:16.933646 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:16.954633 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-b84f7878-c3f6-4634-95ee-ccae54ea0729 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449052 Oct 24 13:35:16.962192 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:35:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:16.967768 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-22142c9d-23d4-42e7-97c7-955854433b21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:17.002151 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-22142c9d-23d4-42e7-97c7-955854433b21 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038454 Oct 24 13:35:17.003093 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 24 13:35:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:19.700110 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-b84f7878-c3f6-4634-95ee-ccae54ea0729 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:19.701789 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-b84f7878-c3f6-4634-95ee-ccae54ea0729 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Oct 24 13:35:19.702210 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:35:20.131928 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-572c6bad-9072-4254-82d4-d3c8ece13de7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5"}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:20.140076 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:20.158031 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-572c6bad-9072-4254-82d4-d3c8ece13de7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449648 Oct 24 13:35:20.158621 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 24 13:35:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:20.171580 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-940ed0f3-e1e3-4e89-a88d-875cb6cef69d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:20.197206 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-940ed0f3-e1e3-4e89-a88d-875cb6cef69d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029956 Oct 24 13:35:20.197790 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 24 13:35:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:35:37.591599 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-572c6bad-9072-4254-82d4-d3c8ece13de7 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:37.593209 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-572c6bad-9072-4254-82d4-d3c8ece13de7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Oct 24 13:35:37.593618 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:37.603958 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:35:37.979345 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-1c913e59-bc9c-4365-8567-a161137a6220 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:37.997198 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-1c913e59-bc9c-4365-8567-a161137a6220 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397659 Oct 24 13:35:37.997725 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 24 13:35:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:39.307776 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-572c6bad-9072-4254-82d4-d3c8ece13de7 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:39.308778 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-572c6bad-9072-4254-82d4-d3c8ece13de7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 24 13:35:39.309169 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:39.833635 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-d75b52f1-e909-40d7-b99b-6dd434228b37 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:39.839000 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.wsgi [None req-d75b52f1-e909-40d7-b99b-6dd434228b37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-d75b52f1-e909-40d7-b99b-6dd434228b37 admin admin] Request method failure captured: Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Accept: application/json Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Accept-Encoding: gzip, deflate Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Connection: keep-alive Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Content-Length: 0 Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Host: 10.222.0.20 Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Openstack-Api-Version: compute 2.92 Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Openstack-System-Scope: None Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: User-Agent: python-novaclient Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Auth-Token: gAAAAABjVpSrpxNngzkjnRHNWKL4l8IV4RJuS0nveLU0g5fQykCQuAJKZzNnIdwjES-7asH-mlFDAZM-SzwVWD4Z6wI3i_I7B4lzx9HRl6xmPqglxFIeP_-9JwSz15bxRhvuGErGnw7Jrsxra3fG7BJmk6fgvUSk2s5mJn4Mcrl9SJMlW4daolE Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Domain-Id: None Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Domain-Name: None Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Identity-Status: Confirmed Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Is-Admin-Project: True Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Domain-Id: default Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Domain-Name: Default Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Name: admin Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Role: member,reader,admin Oct 24 13:35:39.842397 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Roles: member,reader,admin Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant: admin Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant-Name: admin Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User: admin Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Domain-Id: default Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Domain-Name: Default Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Id: 75330c8a27ec4acf96914b6033d2cd61 Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Name: admin Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: method: > Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: exception: Flavor 42 could not be found. Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: action_args: {'id': '42'} Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:35:39.844085 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:39.844986 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.846094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-d75b52f1-e909-40d7-b99b-6dd434228b37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:35:39.847151 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-d75b52f1-e909-40d7-b99b-6dd434228b37 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394158 Oct 24 13:35:39.847151 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 24 13:35:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:39.854273 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-870c488a-23a0-4089-9458-85694233126f admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:39.877750 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-870c488a-23a0-4089-9458-85694233126f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027333 Oct 24 13:35:39.878079 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 24 13:35:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:39.888287 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-b2d1f779-cb16-4c5b-8385-35adbc863e82 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:39.909785 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-b2d1f779-cb16-4c5b-8385-35adbc863e82 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025959 Oct 24 13:35:39.910363 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 24 13:35:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:39.919939 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-d09e5b62-0d41-4f26-8f12-917a7d581881 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:39.926047 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.wsgi [None req-d09e5b62-0d41-4f26-8f12-917a7d581881 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-d09e5b62-0d41-4f26-8f12-917a7d581881 admin admin] Request method failure captured: Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Accept: application/json Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Accept-Encoding: gzip, deflate Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Connection: keep-alive Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Content-Length: 0 Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Host: 10.222.0.20 Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Openstack-Api-Version: compute 2.92 Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Openstack-System-Scope: None Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: User-Agent: python-novaclient Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Auth-Token: gAAAAABjVpSrpxNngzkjnRHNWKL4l8IV4RJuS0nveLU0g5fQykCQuAJKZzNnIdwjES-7asH-mlFDAZM-SzwVWD4Z6wI3i_I7B4lzx9HRl6xmPqglxFIeP_-9JwSz15bxRhvuGErGnw7Jrsxra3fG7BJmk6fgvUSk2s5mJn4Mcrl9SJMlW4daolE Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Domain-Id: None Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Domain-Name: None Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Identity-Status: Confirmed Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Is-Admin-Project: True Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Domain-Id: default Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Domain-Name: Default Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Name: admin Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Role: member,reader,admin Oct 24 13:35:39.929309 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Roles: member,reader,admin Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant: admin Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant-Name: admin Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User: admin Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Domain-Id: default Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Domain-Name: Default Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Id: 75330c8a27ec4acf96914b6033d2cd61 Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Name: admin Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: method: > Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: exception: Flavor 42 could not be found. Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: action_args: {'id': '42'} Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:35:39.930971 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:39.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:39.933230 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-d09e5b62-0d41-4f26-8f12-917a7d581881 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:35:39.934504 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-d09e5b62-0d41-4f26-8f12-917a7d581881 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014354 Oct 24 13:35:39.934504 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 24 13:35:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 24 13:35:41.137284 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-b2d1f779-cb16-4c5b-8385-35adbc863e82 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:41.138412 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-b2d1f779-cb16-4c5b-8385-35adbc863e82 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 24 13:35:41.138819 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:41.657337 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-902fb4bd-6f2c-4069-b95c-83d3be6562b5 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:41.663666 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.wsgi [None req-902fb4bd-6f2c-4069-b95c-83d3be6562b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-902fb4bd-6f2c-4069-b95c-83d3be6562b5 admin admin] Request method failure captured: Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Accept: application/json Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Accept-Encoding: gzip, deflate Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Connection: keep-alive Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Content-Length: 0 Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Host: 10.222.0.20 Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Openstack-Api-Version: compute 2.92 Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Openstack-System-Scope: None Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: User-Agent: python-novaclient Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Auth-Token: gAAAAABjVpStMxFNuR83Z3Zpe4JXCR89u5VlS57fsr2Jv2poqBEQAwqlQ94zM_pcP2IyUcmzzpmvupt7s00z9gl02fvWOv05hq1sGzQUlV2X91NZX9L8QXAgNaFUe8CIZQkloNHgb0XQmFVB0uqdipz4SMSNqcNEG2lj8Hb-2vq49Qtm4sWDTfA Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Domain-Id: None Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Domain-Name: None Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Identity-Status: Confirmed Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Is-Admin-Project: True Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Domain-Id: default Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Domain-Name: Default Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Name: admin Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Role: member,reader,admin Oct 24 13:35:41.665177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Roles: member,reader,admin Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant: admin Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant-Name: admin Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User: admin Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Domain-Id: default Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Domain-Name: Default Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Id: 75330c8a27ec4acf96914b6033d2cd61 Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Name: admin Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: method: > Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: exception: Flavor 84 could not be found. Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: action_args: {'id': '84'} Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:35:41.666749 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:41.667719 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.668909 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-902fb4bd-6f2c-4069-b95c-83d3be6562b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:35:41.670783 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-902fb4bd-6f2c-4069-b95c-83d3be6562b5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390226 Oct 24 13:35:41.670783 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 24 13:35:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:41.677246 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-d67dde0d-f0ec-42bf-aba2-5278ddc2695b admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:41.692073 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-d67dde0d-f0ec-42bf-aba2-5278ddc2695b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018353 Oct 24 13:35:41.692593 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 24 13:35:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:41.701609 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-984c59c5-20c1-4e3b-b12a-a644c20242cd admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:41.716747 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-984c59c5-20c1-4e3b-b12a-a644c20242cd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018572 Oct 24 13:35:41.717900 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 24 13:35:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:41.727094 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-a4113362-f69e-49f4-94ed-0f492f0a09d8 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:41.732008 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.wsgi [None req-a4113362-f69e-49f4-94ed-0f492f0a09d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-a4113362-f69e-49f4-94ed-0f492f0a09d8 admin admin] Request method failure captured: Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Accept: application/json Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Accept-Encoding: gzip, deflate Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Connection: keep-alive Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Content-Length: 0 Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Host: 10.222.0.20 Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Openstack-Api-Version: compute 2.92 Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Openstack-System-Scope: None Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: User-Agent: python-novaclient Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Auth-Token: gAAAAABjVpStMxFNuR83Z3Zpe4JXCR89u5VlS57fsr2Jv2poqBEQAwqlQ94zM_pcP2IyUcmzzpmvupt7s00z9gl02fvWOv05hq1sGzQUlV2X91NZX9L8QXAgNaFUe8CIZQkloNHgb0XQmFVB0uqdipz4SMSNqcNEG2lj8Hb-2vq49Qtm4sWDTfA Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Domain-Id: None Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Domain-Name: None Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Identity-Status: Confirmed Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Is-Admin-Project: True Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Domain-Id: default Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Domain-Name: Default Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Name: admin Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Role: member,reader,admin Oct 24 13:35:41.734082 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Roles: member,reader,admin Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant: admin Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant-Name: admin Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User: admin Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Domain-Id: default Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Domain-Name: Default Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Id: 75330c8a27ec4acf96914b6033d2cd61 Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Name: admin Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: method: > Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: exception: Flavor 84 could not be found. Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: action_args: {'id': '84'} Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:35:41.735617 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:41.736547 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:41.737628 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-a4113362-f69e-49f4-94ed-0f492f0a09d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:35:41.738702 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-a4113362-f69e-49f4-94ed-0f492f0a09d8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011818 Oct 24 13:35:41.738702 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 24 13:35:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 24 13:35:42.930956 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-984c59c5-20c1-4e3b-b12a-a644c20242cd admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:42.931979 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-984c59c5-20c1-4e3b-b12a-a644c20242cd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 24 13:35:42.932374 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:43.452434 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-ee2a2a8b-3e67-4e2e-bd5d-3c7b7a6cece9 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:43.458278 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.wsgi [None req-ee2a2a8b-3e67-4e2e-bd5d-3c7b7a6cece9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-ee2a2a8b-3e67-4e2e-bd5d-3c7b7a6cece9 admin admin] Request method failure captured: Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Accept: application/json Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Accept-Encoding: gzip, deflate Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Connection: keep-alive Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Content-Length: 0 Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Host: 10.222.0.20 Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Openstack-Api-Version: compute 2.92 Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Openstack-System-Scope: None Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: User-Agent: python-novaclient Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Auth-Token: gAAAAABjVpSuPeA7wwG9-zRJCxl4kjACvuTeiaW1Cows4m8K9bxGCXxCSwTqBwN3wDYqkixW9mbE8QPIOgAqtUIO3NhayowF7my5XJ-aXTWrUzDeyRv-YgWQowVJXy559zxpi5XK6q25aNlF2O7CmE4hdqrdvsZWq_wK21DNF89OFWIamvhtgMU Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Domain-Id: None Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Domain-Name: None Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Identity-Status: Confirmed Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Is-Admin-Project: True Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Domain-Id: default Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Domain-Name: Default Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Project-Name: admin Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Role: member,reader,admin Oct 24 13:35:43.459768 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Roles: member,reader,admin Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant: admin Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-Tenant-Name: admin Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User: admin Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Domain-Id: default Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Domain-Name: Default Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Id: 75330c8a27ec4acf96914b6033d2cd61 Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: X-User-Name: admin Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: method: > Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: exception: Flavor 451 could not be found. Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: action_args: {'id': '451'} Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:35:43.461312 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:43.462257 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.463532 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-ee2a2a8b-3e67-4e2e-bd5d-3c7b7a6cece9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:35:43.464774 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-ee2a2a8b-3e67-4e2e-bd5d-3c7b7a6cece9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391520 Oct 24 13:35:43.464774 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 24 13:35:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:43.471334 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-eca27307-38c2-4970-9889-216fcc3b0f9e admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:43.486273 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-eca27307-38c2-4970-9889-216fcc3b0f9e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019096 Oct 24 13:35:43.486800 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 24 13:35:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:35:43.496016 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:43.510660 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018138 Oct 24 13:35:43.511184 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 24 13:35:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:35:43.520598 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-6a0b7603-881b-4154-9584-729b9b07945e admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:43.525475 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.wsgi [None req-6a0b7603-881b-4154-9584-729b9b07945e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-6a0b7603-881b-4154-9584-729b9b07945e admin admin] Request method failure captured: Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Accept: application/json Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Accept-Encoding: gzip, deflate Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Connection: keep-alive Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Content-Length: 0 Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Host: 10.222.0.20 Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Openstack-Api-Version: compute 2.92 Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Openstack-System-Scope: None Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: User-Agent: python-novaclient Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Auth-Token: gAAAAABjVpSuPeA7wwG9-zRJCxl4kjACvuTeiaW1Cows4m8K9bxGCXxCSwTqBwN3wDYqkixW9mbE8QPIOgAqtUIO3NhayowF7my5XJ-aXTWrUzDeyRv-YgWQowVJXy559zxpi5XK6q25aNlF2O7CmE4hdqrdvsZWq_wK21DNF89OFWIamvhtgMU Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Domain-Id: None Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Domain-Name: None Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Identity-Status: Confirmed Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Is-Admin-Project: True Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Domain-Id: default Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Domain-Name: Default Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Project-Name: admin Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Role: member,reader,admin Oct 24 13:35:43.527026 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Roles: member,reader,admin Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73bbcd87686646c2a2c2fdd8f0e7bdd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant: admin Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant-Id: 73bbcd87686646c2a2c2fdd8f0e7bdd8 Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-Tenant-Name: admin Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User: admin Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Domain-Id: default Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Domain-Name: Default Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Id: 75330c8a27ec4acf96914b6033d2cd61 Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: X-User-Name: admin Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: method: > Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: exception: Flavor 451 could not be found. Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: action_args: {'id': '451'} Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:35:43.528529 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:43.529435 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: ERROR nova.api.openstack.wsgi Oct 24 13:35:43.531134 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-6a0b7603-881b-4154-9584-729b9b07945e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:35:43.532327 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-6a0b7603-881b-4154-9584-729b9b07945e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011257 Oct 24 13:35:43.532327 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 24 13:35:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:35:44.733087 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:44.734090 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Oct 24 13:35:44.734520 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:45.262567 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-f8aa1d1f-b92e-4d30-be8d-981e183a07ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:45.282820 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-f8aa1d1f-b92e-4d30-be8d-981e183a07ea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.407665 Oct 24 13:35:45.283358 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 24 13:35:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:46.519259 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:46.520283 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 24 13:35:46.520680 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:47.042270 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-dd0704b2-e976-4dfa-8e07-12bef6140be8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:47.061515 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-dd0704b2-e976-4dfa-8e07-12bef6140be8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404094 Oct 24 13:35:47.062139 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 24 13:35:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:48.268610 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:48.269639 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 24 13:35:48.270036 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:48.789808 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-e08c81a7-9d76-41a3-a417-72c82593e4a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:48.808822 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-e08c81a7-9d76-41a3-a417-72c82593e4a5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400712 Oct 24 13:35:48.809357 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 24 13:35:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:50.021041 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:50.022231 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Oct 24 13:35:50.022638 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:50.554292 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-613f71e6-c9bf-47c0-8057-99bace42fd41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:35:50.572542 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-613f71e6-c9bf-47c0-8057-99bace42fd41 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405416 Oct 24 13:35:50.573077 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 24 13:35:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:35:51.780030 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:51.781102 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Oct 24 13:35:51.781573 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:35:52.299077 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-119ebf0f-0e95-46db-ab66-017da4913bd7 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:35:52.319297 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-119ebf0f-0e95-46db-ab66-017da4913bd7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400268 Oct 24 13:35:52.319828 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 24 13:35:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:49.736679 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:49.737685 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-aa8ca0a5-6d22-4ca9-b23a-d672a7a747da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 24 13:36:49.738092 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 24 13:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:36:49.749227 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:50.129473 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-f67f2f00-9768-40c0-9567-6757ead1a74f admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:50.149334 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-f67f2f00-9768-40c0-9567-6757ead1a74f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405088 Oct 24 13:36:50.149874 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 24 13:36:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:36:50.177424 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-06153f98-d312-4532-b99b-9ad82664b4b6 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:50.180904 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_api:SELECT=14 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:36:50.185849 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-06153f98-d312-4532-b99b-9ad82664b4b6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015605 Oct 24 13:36:50.187015 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Oct 24 13:36:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:50.200161 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-23862817-7ab7-41ad-af13-3420d5762264 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:50.208615 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-23862817-7ab7-41ad-af13-3420d5762264 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011984 Oct 24 13:36:50.209359 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Oct 24 13:36:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:50.221080 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:50.228404 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011216 Oct 24 13:36:50.228917 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Oct 24 13:36:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:36:50.240593 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-3f5e6985-adb6-48f0-ba3c-c3aa8aa93d70 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:36:50.247786 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-3f5e6985-adb6-48f0-ba3c-c3aa8aa93d70 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010771 Oct 24 13:36:50.248301 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Oct 24 13:36:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:39:46.703416 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:46.704415 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Oct 24 13:39:46.704813 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:46.849411 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_api:SELECT=6 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:47.011965 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:47.016988 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:47.017461 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:47.017882 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:47.018609 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:47.019048 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:47.019456 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:47.051252 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-241c6226-9eef-41a1-abec-f640f204f726 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.203305 Oct 24 13:39:47.051795 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 24 13:39:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:39:48.141463 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:48.142524 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 24 13:39:48.142942 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:39:48.334252 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:48.337652 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:48.338132 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:48.338591 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:48.339311 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:39:48.339760 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:39:48.340177 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:39:48.360423 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-2d3efa3e-1cf3-4cf6-ae17-13accdd6fb64 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078995 Oct 24 13:39:48.360975 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 24 13:39:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:39:59.824662 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:39:59.825658 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Oct 24 13:39:59.826052 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:39:59.970549 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_cell0:SELECT=4 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:59.971261 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_cell1:SELECT=4 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:39:59.971866 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG dbcounter [-] [110425] Writing DB stats nova_api:SELECT=8 {{(pid=110425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:00.020122 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:00.023519 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:00.023987 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:00.024446 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:00.025266 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:00.025706 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:00.026114 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:00.056397 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-a8f24ccc-c5e1-408c-ae0f-f2a3c3ae8341 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.090269 Oct 24 13:40:00.057320 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 24 13:39:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:40:01.143059 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG nova.api.openstack.wsgi [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] Calling method '>' {{(pid=110426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:01.144061 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: INFO nova.api.openstack.requestlog [None req-4d968e79-be2a-4379-ace1-1dfd43162102 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 24 13:40:01.144464 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: [pid: 110426|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 24 13:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:40:01.335035 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG nova.api.openstack.wsgi [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Calling method '>' {{(pid=110425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:40:01.338384 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:01.338864 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:01.339287 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:01.339998 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:40:01.340433 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:40:01.340845 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: DEBUG oslo_concurrency.lockutils [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:40:01.363061 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: INFO nova.api.openstack.requestlog [None req-2f80dfa1-239a-42ea-a443-d69fb3cfd53e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078737 Oct 24 13:40:01.363545 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: [pid: 110425|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 24 13:40:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:40:58.033392 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: Mon Oct 24 13:40:58 2022 - graceful shutdown triggered... Oct 24 13:40:58.033529 dv-cinder-862490-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 24 13:40:58.034783 dv-cinder-862490-2-iscsi devstack@n-api.service[110425]: Gracefully killing worker 1 (pid: 110425)... Oct 24 13:40:58.035231 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: Gracefully killing worker 2 (pid: 110426)... Oct 24 13:40:58.162714 dv-cinder-862490-2-iscsi devstack@n-api.service[110426]: DEBUG dbcounter [-] [110426] Writing DB stats nova_api:SELECT=4 {{(pid=110426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:40:59.035870 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: worker 1 buried after 1 seconds Oct 24 13:40:59.036318 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: worker 2 buried after 1 seconds Oct 24 13:40:59.036318 dv-cinder-862490-2-iscsi devstack@n-api.service[110424]: goodbye to uWSGI. Oct 24 13:40:59.037428 dv-cinder-862490-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 24 13:40:59.038001 dv-cinder-862490-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 24 13:40:59.040759 dv-cinder-862490-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 13:40:59.055533 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:40:59 2022] *** Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: nodename: dv-cinder-862490-2-iscsi Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: machine: x86_64 Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: clock source: unix Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: pcre jit disabled Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: detected number of CPU cores: 4 Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: current working directory: / Oct 24 13:40:59.057512 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: your processes number limit is 47680 Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: your memory page size is 4096 bytes Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: detected max file descriptor number: 2048 Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: lock engine: pthread robust mutexes Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: thunder lock: enabled Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 13:40:59.058194 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:40:59.099039 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: Python main interpreter initialized at 0x555b66cd89c0 Oct 24 13:40:59.099039 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: python threads support enabled Oct 24 13:40:59.099039 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: your server socket listen backlog is limited to 100 connections Oct 24 13:40:59.099039 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:40:59.099506 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:40:59.099506 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: *** Operational MODE: preforking *** Oct 24 13:40:59.099768 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:40:59.099768 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: spawned uWSGI master process (pid: 125437) Oct 24 13:40:59.099978 dv-cinder-862490-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 24 13:40:59.102230 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: spawned uWSGI worker 1 (pid: 125456, cores: 1) Oct 24 13:40:59.102230 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: spawned uWSGI worker 2 (pid: 125457, cores: 1) Oct 24 13:40:59.102230 dv-cinder-862490-2-iscsi devstack@n-api.service[125437]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:40:59.768196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:40:59.771109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:41:01.022977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:41:01.022977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: from cryptography.utils import int_from_bytes Oct 24 13:41:01.023616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:41:01.023616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: from cryptography.utils import int_from_bytes Oct 24 13:41:01.030493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:41:01.030493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: from cryptography.utils import int_from_bytes Oct 24 13:41:01.030958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:41:01.030958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: from cryptography.utils import int_from_bytes Oct 24 13:41:03.476755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:41:03.477350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:41:03.477632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:41:03.477851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:41:03.478125 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:41:03.478511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.478846 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.479174 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.479496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.479829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.480141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.480466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.480786 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.481119 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.481390 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.481709 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.482037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862490-2-iscsi {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.482526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.482847 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.483165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.483490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.483815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.484134 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.484435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.484947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.486957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.487573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.490307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.490307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.490307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.490580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:41:03.490580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:41:03.491070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.491151 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:41:03.491223 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.491309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:41:03.491309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:41:03.491457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.491529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.491604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.491681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.491996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.492160 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.492160 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.492459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862490-2-iscsi {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.492609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.492758 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.492908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.493059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.493211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.493354 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.493534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.493678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.493844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.494001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.494184 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.494344 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.496038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.496219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862490-2-iscsi {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.496386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.496544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.496701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.496856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497172 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497327 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.497944 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.498101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.498287 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.498438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.498587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.498736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.498907 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499062 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499366 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.499974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.500124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.500273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.500422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.500565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.500716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.500882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.501037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.501185 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.501335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.501484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.501641 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.501641 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.502702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.502887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.503044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862490-2-iscsi {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.503338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.503596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.503757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.503910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.504954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.505112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.505265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.505413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.505577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.505726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.505875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506820 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.506978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.507130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.507278 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.507430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.507583 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.507738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.507880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508173 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508314 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508756 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.508897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509509 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.509948 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.510096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.510268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.510428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.510583 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.510736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.510884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.511975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.512156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.512885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513799 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.513942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.514097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.514263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.514419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.514569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.514724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.514867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515018 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515641 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.515931 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.516085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.516296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.516494 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.516652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.516795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.516943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.517233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.517416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.517712 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.517883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.518051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.518230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.518422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.518573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.519268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.519434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.519588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.519731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.519887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520173 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.520993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.521143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.521301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.521443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.521585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.521726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.521875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.522068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.522249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.522546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.523158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.523311 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.523462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.523617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.523769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.523919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524061 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.524949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.525991 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.526141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.526389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.526535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.526682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.526830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.526980 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.527133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.527366 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.527526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.527677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.527827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.527984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.528144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.528294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.528447 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.528598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.528747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.528898 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529208 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529358 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.529953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.530110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.530288 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.530447 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.530598 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.530752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.530902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.531054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.531203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.531354 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.531502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.531763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.531763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.532056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.532251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.532402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.532567 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.533202 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.533364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.533517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.535332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.535501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.535654 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.535804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.535961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.536112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.536314 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.536465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.536608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.536756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.536899 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.537047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.537199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.537377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.537606 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.537761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.537904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.538066 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.538261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.538419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.538570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.538720 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.538861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.539016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.539167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.539328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.539471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.539619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.539768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.539922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.540071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.540225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.540374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.540524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.540674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:41:03.540825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.540975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.541126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.541293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.541444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.541444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.541721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.541876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.542044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.542350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.542501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.542645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.543324 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.543492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.543637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.543786 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.543946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544240 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.544993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.545149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.545291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.545435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.545583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.545735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.545884 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.546100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.546279 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.546426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.547149 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.547299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.547452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.547622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.547847 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.548014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.548172 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.548605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.548760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.548911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.549945 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.550145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.550398 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.550568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.550719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.550868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551317 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.551914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.552064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.552214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.552402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.552562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.552707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.552861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.553634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.553793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.553937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.554079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.554257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.554405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.554555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.554698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.554849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.555925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556082 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.556949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.557114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.557263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.557406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.557554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.557707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.557875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.558109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.558109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.558414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.558567 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.558724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.558867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.559020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.559170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.559318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.559461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.559615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.559977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.560137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.560287 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.560437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.560580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.560734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.560885 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.561988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562070 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562278 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562686 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.562959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563240 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563903 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.563987 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.564987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565592 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.565982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566707 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.566959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.567904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568270 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568807 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.568988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.569914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570184 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.570937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571899 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.571988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572168 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572256 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572345 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.572934 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573279 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573455 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.573964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574447 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574796 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.574967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575226 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575774 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.575878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.576090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.576181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.576400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.576492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.576714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.576806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577433 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.577959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.578058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.578305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.578399 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.578623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.578711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.578948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579259 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.579973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.580197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.580296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.580508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.580646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.580819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.580921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.581160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.581789 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.581949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.582151 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.582323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.582505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.582717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.582809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.582942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.583131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.583263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.583451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.583715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.583819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.583900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.584113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.584207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.584457 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.584566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.584696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.584816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.585013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.585144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.585329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.585462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.585642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.585777 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.586429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.586429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.586788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.587046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.587431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.587536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.587685 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.587768 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.588977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.589073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.589264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.589360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.589593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.589692 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.589908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.590007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.590316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.590416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.590555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.590647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.590870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.591191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.591291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.591526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.591616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.591836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.591936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.592159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.592259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.592486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.592579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.592789 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.592933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.593108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.593201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.593426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.593531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.593787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.593890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.594067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.594181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.594411 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.594537 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.594733 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.594888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.595994 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.596090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.596312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.596432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.596625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.596729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.597495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.597640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.597819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.597923 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.598137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.598297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.598479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.598583 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.598804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.598920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.599121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.599440 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.599544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.599754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.599857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.600086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.600179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.600402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.600556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.600716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.600817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.601029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.601141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.601341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.601442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.601698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.601793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.602982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.603087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.603295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.603396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.603612 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.603720 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.603927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604035 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604345 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604654 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604864 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.604959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.605178 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.605272 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.605489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.605595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.605797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.605896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.606107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.606236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.606455 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.606703 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.606862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607617 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.607904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608331 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.608911 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609194 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.609911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.610066 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.610301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.610405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.610515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.610699 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.610828 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611021 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611144 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.611957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.612096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.612271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.612404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.612611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.612945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.613057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.613334 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.613426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.613649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.613749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.613992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.614095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.614281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.614371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.614605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.614702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.614980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.615939 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.616163 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.616269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.616473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.616580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.616781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.616927 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.617090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.617205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.617410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.617540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.617703 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.617863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.618966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.619980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.620206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.620321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.620512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.620608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.620817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.620931 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.621122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.621225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.621451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.621543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.621762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.621866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.622070 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.622200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.622408 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.622502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.622717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.622827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623340 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623668 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.623986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.624094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.624294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.624407 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.624605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.624721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.624915 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.625019 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.625226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.625320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.625535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.625644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.625849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.626905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.627105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.627199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.627414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.627519 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.627740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.627832 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.628051 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.628189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.628408 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.628607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.628707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.628941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.629041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.629259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.629353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.629579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.629732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.629902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.630982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.631135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.631274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.631454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.631596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.631769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.631910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.632087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.632229 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.632403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.632545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.632770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.633975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.634980 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.635211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.635541 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.635652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.635851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.635956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.636167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.636272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.636482 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.636595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.636799 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.636919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.637111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.637213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.637426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.637556 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.637741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.637901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.638067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.638248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.638386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.638493 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.638704 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.638800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639020 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639442 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.639962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.640058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.640270 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.640367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.640601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.640696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.640914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.641952 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.642156 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.642276 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.642488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.642590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.642917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.643177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.643307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.643504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.643607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.644356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.644524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.644902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.645026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.645232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.645338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.645555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.645650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.645884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646552 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.646977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.647190 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.647301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.647520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.647621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.647850 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.647953 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.648167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.648268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.648481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.648649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.648789 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.648883 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.649116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.649237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.649425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.649529 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.649734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.649830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.650045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.650154 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.650398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.650505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.650709 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.650813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.651042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.651146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.651448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.651541 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.651764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.651858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.652074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.652182 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.652382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.652479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.652698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.652800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.653959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.654054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.654301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.654400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.654621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.654716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.654936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.655989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.656191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.656303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.656504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.656598 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.656822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.656916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.657150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.657253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.657472 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.657576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.657780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.657874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.658108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.658216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.658448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.658552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.658759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.658854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.659071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.659512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.660365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.660483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.660684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.660792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.660994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.661090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.661311 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.661414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.661622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.661717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.661933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.662056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.662285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.662395 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.662599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.662734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.662916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.663072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.663232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.663401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.663549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.663718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.663857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664372 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664494 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.664997 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.665115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.665310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.665417 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.665622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.665726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.665930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.666045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.666266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.666392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.666582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.666700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.666890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667015 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667514 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.667964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.668108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.668251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.668428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.668588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.668741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.668885 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669182 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.669969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.670215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.670375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.670530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.670682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.670825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.670974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.671140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.671284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.671501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.671646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.671795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.671946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.672096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.672271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.672439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.672583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.672735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.672877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.673929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.674083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.674262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.674357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.674468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.674645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.674778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.675134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.675287 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.675432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.675630 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.675757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.675955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.676058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.676281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.676413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.676604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.676706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.676928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677344 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.677974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.678220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.678317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.678542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.678636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.678866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.678975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.679191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.679284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.679515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.679617 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.679837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.679938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.680159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.680259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.680481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.680586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.680804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.680911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.681120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.681219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.681442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.681544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.681765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.681857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.682088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.682203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.682455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.682643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.682780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.682977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.683100 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.683299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.683404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.683636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.683728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.683938 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.684030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.684258 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.684364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.684579 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.684678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.684901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685230 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685541 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.685988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.686141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.686318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.686473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.686574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.686806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.686954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.687149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.687316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.687466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.687608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.687784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.687982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.688137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.688305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.688461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.688646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.688798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.688980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.689128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.689311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.689456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.689636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.689793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.689959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.690105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.690310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.690422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.691170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.691293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.691482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.691586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.691806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.691909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.692121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.692225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.692433 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.692528 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.692761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.692856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.693079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.693188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.693389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.693486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.693713 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.693830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.694028 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.694124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.694417 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.694594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.694741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.694947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.695046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.695275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.695379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.695607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.695882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.695977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.696201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.696304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.696541 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.696642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.696868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.696961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.697180 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.697274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.697492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.697587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.697811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.697918 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.698129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.698255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.698467 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.698562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.698776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.698893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.699089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.699190 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.699399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.699507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.699707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.699815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700331 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700824 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.700957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.701059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.701266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.701367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.701579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.701800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.701905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.702152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.702289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.702496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.702599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.702826 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.702928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.703136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.703231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.703457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.703561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.703765 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.703861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.704080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.704192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.704391 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.704493 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.704706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.704810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705344 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705654 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705748 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.705963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.706066 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.706882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.707007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.707197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.707456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.707658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.707783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.707890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.708105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.708200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.708418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.708513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.708791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.708893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.709066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.709159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.709379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.709474 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.709692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.709943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.710048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.710318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.710429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.710635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.710757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.710950 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711584 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711692 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711895 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.711997 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.712209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.712302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.712517 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.712623 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.712835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.712929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.713150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.713244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.713468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.713570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.713784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.713886 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.714098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.714214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.714438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.714534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.714747 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.714841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.715062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.715163 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.715377 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.715484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.715691 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.715791 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.716945 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.717050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.717263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.717504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.717653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.717852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.717984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.718198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.718300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.718547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.718650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.718869 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.718976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.719185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.719277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.719498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.719590 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.719810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.719913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.720123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.720227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.720447 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.720546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.720770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.720889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.721084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.721236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.721380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.721529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.721704 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.721798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.722092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730751 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730847 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.730936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731565 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731657 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731843 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.731937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732024 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732322 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732782 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732870 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.732956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.733940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734024 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.734925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735368 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735895 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.735985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736522 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.736963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737417 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737618 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.737975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.738063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.738137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739396 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739590 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.739952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740344 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740421 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.740941 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.741914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.742952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743226 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743498 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.743948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744036 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744397 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744828 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.744922 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.745093 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.745243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.745416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.745565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.745739 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.745888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.746074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.746209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.746435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.746542 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.746756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.746852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.747088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.747191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.747423 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.747517 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.747768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.747865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.748089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.748205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.748438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.748545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.748735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.748832 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749162 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749467 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.749933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:41:03.750035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.750355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.750673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.750995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.751314 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.751635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.751952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.752269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.752592 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.752914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.753811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.754251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.754576 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.754912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.755248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.755601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.755923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.756275 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.756611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.756933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.757253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.757565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:41:03.757812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:41:03.812982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO dbcounter [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Registered counter for database nova_api Oct 24 13:41:03.821183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO dbcounter [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Registered counter for database nova_api Oct 24 13:41:03.835146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_db.sqlalchemy.engines [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:03.842334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writer thread running {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:03.842716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:03.851428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writer thread running {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:03.901216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.context [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1e20d1c-cda7-4a62-9810-539755b5196c(cell1) {{(pid=125457) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:41:03.905302 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:03.905796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:03.907414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:03.908120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:03.908561 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:03.908674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.context [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1e20d1c-cda7-4a62-9810-539755b5196c(cell1) {{(pid=125456) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:41:03.911381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:03.913393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO dbcounter [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Registered counter for database nova_cell0 Oct 24 13:41:03.913556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:03.914028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:03.915725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:03.916452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:03.916897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:03.917468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO dbcounter [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Registered counter for database nova_cell1 Oct 24 13:41:03.918902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:03.921020 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO dbcounter [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Registered counter for database nova_cell0 Oct 24 13:41:03.927021 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO dbcounter [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Registered counter for database nova_cell1 Oct 24 13:41:03.927213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_db.sqlalchemy.engines [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:03.928038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_db.sqlalchemy.engines [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:03.933200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writer thread running {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:03.933338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:03.935980 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:03.940243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writer thread running {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:03.946875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writer thread running {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:04.075904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writer thread running {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:04.086583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO dbcounter [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Registered counter for database nova_cell0 Oct 24 13:41:04.094102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_db.sqlalchemy.engines [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:04.094639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO dbcounter [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Registered counter for database nova_cell0 Oct 24 13:41:04.099227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writer thread running {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:04.102143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_db.sqlalchemy.engines [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:41:04.107017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writer thread running {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:41:04.428723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: WARNING keystonemiddleware.auth_token [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:41:04.436594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: WARNING keystonemiddleware.auth_token [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:41:04.461775 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: WARNING keystonemiddleware.auth_token [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:41:04.469223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: WARNING keystonemiddleware.auth_token [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:41:04.791763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: WARNING keystonemiddleware.auth_token [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:41:04.797755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: WARNING keystonemiddleware.auth_token [None req-003e5ab7-c987-4b13-a7f6-995886f0d875 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:41:04.804364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555b66cd89c0 pid: 125457 (default app) Oct 24 13:41:04.856155 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: WARNING keystonemiddleware.auth_token [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:41:04.862355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: WARNING keystonemiddleware.auth_token [None req-1ebd9eb6-6aba-4a1e-9952-a9a11cd4557f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:41:04.870138 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555b66cd89c0 pid: 125456 (default app) Oct 24 13:41:41.865951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:41.867780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:41.869541 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:41.870610 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:43.859263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9a1d12ae-eb72-4fc1-93d7-68ca875d82f6 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Action: 'create', calling method: .version_select at 0x7f8dc3969ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1167204702"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:45.554779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:45.555250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:45.557432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:45.558696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:41:45.641068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9a1d12ae-eb72-4fc1-93d7-68ca875d82f6 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.782017 Oct 24 13:41:45.652233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Oct 24 13:41:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3804 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 13:41:45.667793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-24f4f725-9bf7-4fda-b91f-a284bcf6e23e tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc37ccd30>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:46.077399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-24f4f725-9bf7-4fda-b91f-a284bcf6e23e tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581" status: 200 len: 345 microversion: 2.1 time: 0.423377 Oct 24 13:41:46.078422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:45 2022] GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 => generated 345 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:46.111064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e1de5e1c-bb55-4d24-895a-a57cab1f10cb tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc3932ca0>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:46.932241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e1de5e1c-bb55-4d24-895a-a57cab1f10cb tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/24a0cf5a-2724-465d-b596-55015dd8ca9f" status: 200 len: 350 microversion: 2.1 time: 1.384543 Oct 24 13:41:46.932918 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:45 2022] GET /compute/v2.1/os-volumes/24a0cf5a-2724-465d-b596-55015dd8ca9f => generated 350 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:47.093032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b8c847b4-3f18-4a0d-9790-f9a869867931 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3762430>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:47.187857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b8c847b4-3f18-4a0d-9790-f9a869867931 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581" status: 200 len: 346 microversion: 2.1 time: 0.098224 Oct 24 13:41:47.189028 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:47 2022] GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:47.203701 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b594cb2a-0e12-4b58-bbc4-172cbdd6f30b tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Action: 'create', calling method: .version_select at 0x7f8dc3808d30>, body: {"snapshot": {"volume_id": "dc27947d-c532-4e39-a178-3534b5c6e581", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1593510705"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:47.837295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b594cb2a-0e12-4b58-bbc4-172cbdd6f30b tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.638697 Oct 24 13:41:47.843565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 2/5] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Oct 24 13:41:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:47.849576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-20b10a2c-152d-49e7-95d9-28ff1b05cd92 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3762b80>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:47.981518 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-20b10a2c-152d-49e7-95d9-28ff1b05cd92 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.136122 Oct 24 13:41:47.982419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:47 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:47.994717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4547a32a-9760-494b-bd37-d5ea425690a3 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc37c5c10>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:48.107995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4547a32a-9760-494b-bd37-d5ea425690a3 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.116681 Oct 24 13:41:48.108807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 24 13:41:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:48.123121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4c319bc9-9ce4-4e69-89de-519427273aea tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc37ccca0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:48.181423 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4c319bc9-9ce4-4e69-89de-519427273aea tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.064150 Oct 24 13:41:48.182332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:48 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:48.695251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e92bdd8a-6852-498c-9742-7becb73af161 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc3763040>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:48.789501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e92bdd8a-6852-498c-9742-7becb73af161 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/265b6f7a-3913-4532-ac49-6596fcf3aca6" status: 200 len: 350 microversion: 2.1 time: 0.097928 Oct 24 13:41:48.790159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:48 2022] GET /compute/v2.1/os-volumes/265b6f7a-3913-4532-ac49-6596fcf3aca6 => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:49.194625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-209fa85a-9a2e-44a7-b19f-6d5a25f884bf tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3762940>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:49.255554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-209fa85a-9a2e-44a7-b19f-6d5a25f884bf tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.064617 Oct 24 13:41:49.256481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:49 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:49.657726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-87c0fb03-c0f4-410a-a2df-ed0ebc1d57c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: .version_select at 0x7f8dc375dc10>, body: {"keypair": {"name": "tempest-keypair-1467644426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGocZE18efXKjD6skFnv3AEkTJKXLeigPxFAkWEQwJbICcS7jQ4Oi5wQEtOVp4O1/Or98HJcL2Fj7OoiW4/gfTW/9NfV/KrDUqQ+6yV501mueXORvvHGvbv5p6pU2k//bw=="}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:49.718907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-87c0fb03-c0f4-410a-a2df-ed0ebc1d57c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:41:49.729410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-87c0fb03-c0f4-410a-a2df-ed0ebc1d57c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for user 1ea8feefb0614972898c1b1ad28077a8 and project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:41:49.810639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-87c0fb03-c0f4-410a-a2df-ed0ebc1d57c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.521542 Oct 24 13:41:49.822767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 5/11] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:41:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:50.277910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-90b5f1a5-f186-47d5-9b46-319b5646cfef tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3762160>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:50.375299 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-90b5f1a5-f186-47d5-9b46-319b5646cfef tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.104231 Oct 24 13:41:50.376248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:50 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:51.389866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8268e472-960d-4643-88e8-02328435c25a tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3740f70>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:51.462745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8268e472-960d-4643-88e8-02328435c25a tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.076961 Oct 24 13:41:51.464453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:51 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:52.477431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ad7912d6-041f-4c0f-b431-083ae21b1e11 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3762310>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:52.535914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ad7912d6-041f-4c0f-b431-083ae21b1e11 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.062470 Oct 24 13:41:52.536731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:52 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:53.548672 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-59dde387-cc32-469d-93c2-48c26c675d95 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc36ed700>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:53.626309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-59dde387-cc32-469d-93c2-48c26c675d95 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.080834 Oct 24 13:41:53.627505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:53 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:54.640084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-64e2b39e-c14e-433e-8005-19bb060bcab6 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3762940>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:54.742747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-64e2b39e-c14e-433e-8005-19bb060bcab6 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 288 microversion: 2.1 time: 0.106249 Oct 24 13:41:54.748667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:54 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:54.758553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5378217-56fe-4bdb-b0d2-7e90468c6bd9 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc36eddc0>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:55.029931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d5378217-56fe-4bdb-b0d2-7e90468c6bd9 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 202 len: 0 microversion: 2.1 time: 0.274945 Oct 24 13:41:55.031379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 24 13:41:54 2022] DELETE /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:41:55.040787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fd55f81d-2bf8-4e75-af97-ca5d7d367b1e tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc37ccca0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:55.138122 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-61fdafa6-1ede-4304-bf92-28509a308425 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc36edb80>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:55.172806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fd55f81d-2bf8-4e75-af97-ca5d7d367b1e tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 200 len: 287 microversion: 2.1 time: 0.136305 Oct 24 13:41:55.173392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:55 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:55.276942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-61fdafa6-1ede-4304-bf92-28509a308425 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/54e353cb-c689-4b0c-b7c8-628c4589adb5" status: 200 len: 351 microversion: 2.1 time: 0.144668 Oct 24 13:41:55.278236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:55 2022] GET /compute/v2.1/os-volumes/54e353cb-c689-4b0c-b7c8-628c4589adb5 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:41:55.294023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c6801963-dfc5-4e65-b52c-691b8f72a672 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc376d310>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:55.482914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c6801963-dfc5-4e65-b52c-691b8f72a672 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.193830 Oct 24 13:41:55.493617 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 24 13:41:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:55.498810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d389817a-1be7-4644-8c75-ff2bd135c035 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc36ed4c0>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:55.669085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d389817a-1be7-4644-8c75-ff2bd135c035 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.174488 Oct 24 13:41:55.678201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 10/21] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 24 13:41:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:55.691596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-556e437d-451c-4a3f-be2d-f2e5a011849b tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc37629d0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:55.874855 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-556e437d-451c-4a3f-be2d-f2e5a011849b tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.187999 Oct 24 13:41:55.875431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 12/22] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 24 13:41:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:55.897293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c9b7ba0d-16ae-4aba-b164-290425cd9e18 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc37c5280>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:56.185693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c9b7ba0d-16ae-4aba-b164-290425cd9e18 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.298953 Oct 24 13:41:56.187843 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 24 13:41:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:56.194763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da48a7f4-8eb3-474e-934a-6fdd48c72891 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc375df70>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:56.430806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-da48a7f4-8eb3-474e-934a-6fdd48c72891 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] HTTP exception thrown: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da48a7f4-8eb3-474e-934a-6fdd48c72891 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Request method failure captured: Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 HTTP/1.1 Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYVjkdradgw9sWdCSwwDUQ527pjjw1jqlAhA17EGEtqg1o5aXXFuLBlTZWVLV-z6jr5oajSqRKYoU13hZoiXYqnDQCVsEClFvzJCQ1dcy5iDvu_Shq9GhLP_Apd7G_CgrKEP2XtJokp7X0AHMes1ub4jTETKjHRFdtHTojH0S4pAWU Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:41:56.435392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 59988220318042cab2f81f9ed3a57caa Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6'} Oct 24 13:41:56.437207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. (HTTP 404) (Request-ID: req-c6d8ea7b-3326-4d45-861f-caa8e176ceaf) Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.438224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:41:56.440371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 24 13:41:56.441838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. Oct 24 13:41:56.443321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:41:56.446197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da48a7f4-8eb3-474e-934a-6fdd48c72891 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Returning 404 to user: Snapshot e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:41:56.446197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-da48a7f4-8eb3-474e-934a-6fdd48c72891 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6" status: 404 len: 111 microversion: 2.1 time: 0.257040 Oct 24 13:41:56.450992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:41:56 2022] GET /compute/v2.1/os-snapshots/e12182e1-f7f7-4e95-8dc4-5271e8e8f5c6 => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:41:56.477475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-953dc27d-8f67-48b9-bcae-88dd34e3441d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: .version_select at 0x7f8dc37760d0>, body: {"keypair": {"name": "tempest-keypair-341082593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd6gYxBWYZCSgSsI6heYtKLltgsse/8TLW051T6We+XA8Ou89GTv5FmJ/ak5O2i8DOAw3eQArHc2AqT39/3GX+/CXu0heBpRTRKi7a5IASXaejxdIxLIX5UmU2M9zGWxg=="}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:56.482410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a1c20b60-2e66-4765-be76-8cc672035fda tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc414e430>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:56.616796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-953dc27d-8f67-48b9-bcae-88dd34e3441d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:41:56.638583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-953dc27d-8f67-48b9-bcae-88dd34e3441d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:41:56.712155 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a1c20b60-2e66-4765-be76-8cc672035fda tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.259815 Oct 24 13:41:56.713353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 24 13:41:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:56.719536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1957018078", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf4eb23c-4dfb-45bd-a95b-d5fc238c5b23"}], "security_groups": [{"name": "tempest-securitygroup--1685862948"}], "key_name": "tempest-keypair-1467644426", "user_data": "}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:56.771135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-953dc27d-8f67-48b9-bcae-88dd34e3441d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.810465 Oct 24 13:41:56.771836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 13/26] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:41:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:41:56.778680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6cc47ebf-8f2b-4d8e-b630-af52290696bd tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc36e4550>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:56.984827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6cc47ebf-8f2b-4d8e-b630-af52290696bd tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581" status: 202 len: 0 microversion: 2.1 time: 0.211033 Oct 24 13:41:56.985663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:41:56 2022] DELETE /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:41:56.996537 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0bde4bff-02e5-4cfe-9860-5f6699fe42d8 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc373de50>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.277155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0bde4bff-02e5-4cfe-9860-5f6699fe42d8 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.287143 Oct 24 13:41:57.277868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 24 13:41:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:57.282637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-50fe99d8-7c64-4788-b057-246d15e96f82 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc36f8670>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.329591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-50fe99d8-7c64-4788-b057-246d15e96f82 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] HTTP exception thrown: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-50fe99d8-7c64-4788-b057-246d15e96f82 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Request method failure captured: Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 HTTP/1.1 Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYVjkdradgw9sWdCSwwDUQ527pjjw1jqlAhA17EGEtqg1o5aXXFuLBlTZWVLV-z6jr5oajSqRKYoU13hZoiXYqnDQCVsEClFvzJCQ1dcy5iDvu_Shq9GhLP_Apd7G_CgrKEP2XtJokp7X0AHMes1ub4jTETKjHRFdtHTojH0S4pAWU Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:41:57.333972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 59988220318042cab2f81f9ed3a57caa Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'dc27947d-c532-4e39-a178-3534b5c6e581'} Oct 24 13:41:57.335344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. (HTTP 404) (Request-ID: req-ab3615c6-3200-44c9-9d8f-af2b9bf575ca) Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.336137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:41:57.337363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:41:57.340779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.341924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.344639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-50fe99d8-7c64-4788-b057-246d15e96f82 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Returning 404 to user: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:41:57.346236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-50fe99d8-7c64-4788-b057-246d15e96f82 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581" status: 404 len: 109 microversion: 2.1 time: 0.066783 Oct 24 13:41:57.347405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:57 2022] GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:41:57.365237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1f759e8d-c59d-4ba4-8e3f-2be12aef3459 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc36f8160>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.572591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1f759e8d-c59d-4ba4-8e3f-2be12aef3459 tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.223742 Oct 24 13:41:57.573665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Oct 24 13:41:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:41:57.578314 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-97c928a4-6eef-413d-9261-cc9a2e423c42 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3664ca0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.633154 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-97c928a4-6eef-413d-9261-cc9a2e423c42 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] HTTP exception thrown: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-97c928a4-6eef-413d-9261-cc9a2e423c42 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Request method failure captured: Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 HTTP/1.1 Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYVjkdradgw9sWdCSwwDUQ527pjjw1jqlAhA17EGEtqg1o5aXXFuLBlTZWVLV-z6jr5oajSqRKYoU13hZoiXYqnDQCVsEClFvzJCQ1dcy5iDvu_Shq9GhLP_Apd7G_CgrKEP2XtJokp7X0AHMes1ub4jTETKjHRFdtHTojH0S4pAWU Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:41:57.634830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 59988220318042cab2f81f9ed3a57caa Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'dc27947d-c532-4e39-a178-3534b5c6e581'} Oct 24 13:41:57.636293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. (HTTP 404) (Request-ID: req-1ce5c599-e891-4291-861a-5eef12d863ee) Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.637189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:41:57.639186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:41:57.640542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-97c928a4-6eef-413d-9261-cc9a2e423c42 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Returning 404 to user: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-97c928a4-6eef-413d-9261-cc9a2e423c42 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581" status: 404 len: 109 microversion: 2.1 time: 0.061511 Oct 24 13:41:57.641857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 18/31] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:41:57 2022] DELETE /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:41:57.644731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4994ecdb-8cc4-49c6-b28a-793a6736564b tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] Calling method '.version_select at 0x7f8dc36645e0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.808017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4994ecdb-8cc4-49c6-b28a-793a6736564b tempest-VolumesTestJSON-641377817 tempest-VolumesTestJSON-641377817-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.169941 Oct 24 13:41:57.818373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 19/32] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 24 13:41:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:41:57.828666 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-24358fe5-154a-4c7e-b5a2-b4c5580e2d40 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Calling method '.version_select at 0x7f8dc3664310>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:41:57.857788 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-24358fe5-154a-4c7e-b5a2-b4c5580e2d40 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] HTTP exception thrown: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-24358fe5-154a-4c7e-b5a2-b4c5580e2d40 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Request method failure captured: Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 HTTP/1.1 Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYVjkdradgw9sWdCSwwDUQ527pjjw1jqlAhA17EGEtqg1o5aXXFuLBlTZWVLV-z6jr5oajSqRKYoU13hZoiXYqnDQCVsEClFvzJCQ1dcy5iDvu_Shq9GhLP_Apd7G_CgrKEP2XtJokp7X0AHMes1ub4jTETKjHRFdtHTojH0S4pAWU Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:41:57.859942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb21fa4a8de149b29f5324dc2d80464a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: fb21fa4a8de149b29f5324dc2d80464a Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1759992160 Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 59988220318042cab2f81f9ed3a57caa Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1759992160-project Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'dc27947d-c532-4e39-a178-3534b5c6e581'} Oct 24 13:41:57.862365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. (HTTP 404) (Request-ID: req-26c74aec-f505-4bd3-af73-e12d4afb58cb) Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.864293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:41:57.866152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:41:57.869297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. Oct 24 13:41:57.872695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:41:57.874330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] validate_networks() for [('bf4eb23c-4dfb-45bd-a95b-d5fc238c5b23', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:41:57.875010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-24358fe5-154a-4c7e-b5a2-b4c5580e2d40 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] Returning 404 to user: Volume dc27947d-c532-4e39-a178-3534b5c6e581 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:41:57.875010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-24358fe5-154a-4c7e-b5a2-b4c5580e2d40 tempest-VolumesSnapshotsTestJSON-1759992160 tempest-VolumesSnapshotsTestJSON-1759992160-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581" status: 404 len: 109 microversion: 2.1 time: 0.045747 Oct 24 13:41:57.875010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 20/33] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:41:57 2022] GET /compute/v2.1/os-volumes/dc27947d-c532-4e39-a178-3534b5c6e581 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:41:57.982969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1202682183", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:58.116979 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] validate_networks() for [('94b6e578-e64e-47ab-b529-0c7aff6ffe99', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:41:59.313932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:41:59.313932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:41:59.313932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:41:59.313932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:41:59.313932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:41:59.328600 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:59.329089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:59.329520 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:59.330301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:59.330753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:59.331167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:59.409066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:41:59.420880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for user 1ea8feefb0614972898c1b1ad28077a8 and project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:41:59.450251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:41:59.455729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:41:59.618375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4020b2c7-7e74-4b6c-9b47-fd3d1ac0a122 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.903635 Oct 24 13:41:59.620011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 14/34] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:41:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:41:59.854254 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1838863331", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "networks": [{"uuid": "2604fa44-de01-4bd7-a914-86b67eec1d5b"}]}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:41:59.945343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] validate_networks() for [('2604fa44-de01-4bd7-a914-86b67eec1d5b', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:41:59.950463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:41:59.964644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:41:59.965490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:41:59.966841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:41:59.968162 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:41:59.997458 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:41:59.998601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:41:59.999038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:41:59.999773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:00.000243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:00.000636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:00.093312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for project d506ce8ca200496cbc15d09f49eab942. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:42:00.108419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for user be793f4685f94beba74adedbc02ee50a and project d506ce8ca200496cbc15d09f49eab942. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:42:00.142416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:42:00.146739 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:42:00.351082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-aef47684-3266-49f8-a181-ebffc8ffdf0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.476875 Oct 24 13:42:00.372557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 21/35] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:41:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:42:00.406892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e4845c43-8b47-4b59-992f-2cd0f9355dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:00.411178 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e4845c43-8b47-4b59-992f-2cd0f9355dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:00.838529 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e4845c43-8b47-4b59-992f-2cd0f9355dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:00.896281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e4845c43-8b47-4b59-992f-2cd0f9355dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1238 microversion: 2.1 time: 0.510760 Oct 24 13:42:00.919811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 22/36] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:00 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1238 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:00.945466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f1f6760f-9da8-4a22-9bd1-4bd78961b512 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:00.948789 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f1f6760f-9da8-4a22-9bd1-4bd78961b512 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:01.202450 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f1f6760f-9da8-4a22-9bd1-4bd78961b512 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:01.216087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f1f6760f-9da8-4a22-9bd1-4bd78961b512 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1222 microversion: 2.1 time: 0.293123 Oct 24 13:42:01.219011 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 23/37] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:00 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1222 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:01.508543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:42:01.509003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:42:01.510740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:42:01.511085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:42:01.511511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:42:01.541113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:01.542769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:01.543212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:01.548551 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:01.549909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:01.552962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:01.621705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1894525131", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:01.626415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Getting quotas for project ab3a235b26aa4c93b2354d2af757873e. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:42:01.649058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Getting quotas for user 9cfcee4879df4843867f69c5091df370 and project ab3a235b26aa4c93b2354d2af757873e. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:42:01.699790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:42:01.716731 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:42:01.789815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] validate_networks() for [('94b6e578-e64e-47ab-b529-0c7aff6ffe99', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:42:01.921940 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-40869d77-c804-4df8-884e-f4e4b5674775 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.300635 Oct 24 13:42:01.925557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 15/38] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:42:01.934372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-eff0c04e-b246-4836-8d0d-70156fba8ae0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:01.938348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-eff0c04e-b246-4836-8d0d-70156fba8ae0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:02.145827 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-eff0c04e-b246-4836-8d0d-70156fba8ae0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:02.181677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-eff0c04e-b246-4836-8d0d-70156fba8ae0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1238 microversion: 2.1 time: 0.253817 Oct 24 13:42:02.183993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 16/39] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:01 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1238 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:02.220985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f7444e5e-2e1a-4c51-ae74-3eca651b2558 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:02.224737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f7444e5e-2e1a-4c51-ae74-3eca651b2558 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:02.406976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f7444e5e-2e1a-4c51-ae74-3eca651b2558 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:02.422183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f7444e5e-2e1a-4c51-ae74-3eca651b2558 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1215 microversion: 2.1 time: 0.230244 Oct 24 13:42:02.423239 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 17/40] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:02 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:03.224626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:03.226072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:03.236263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.237581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.238286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.241939 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.248115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.250518 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.698187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:03.724829 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bb1c1b82-246c-4d25-9be8-fc626fb690cb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1234 microversion: 2.1 time: 0.510415 Oct 24 13:42:03.726812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 18/41] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:03 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1234 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:03.731601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:03.732214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:03.745483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.745960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.746428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.753421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.753909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.754521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.851379 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:42:03.852091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:42:03.852369 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:42:03.852900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:42:03.853247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:42:03.871095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:03.874957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.875462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.875906 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.878317 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:03.880554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:03.882077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:03.902068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-57a4ea28-4989-4371-81fb-e45071c3f45a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1211 microversion: 2.1 time: 0.174042 Oct 24 13:42:03.926768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:03 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:03.946713 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for project d506ce8ca200496cbc15d09f49eab942. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:42:03.954653 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1597031610", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "051d9444-c9f6-450e-99dd-61dcbd128cbe"}], "security_groups": [{"name": "tempest-securitygroup--63696292"}], "key_name": "tempest-keypair-341082593", "user_data": "}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:03.962772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for user be793f4685f94beba74adedbc02ee50a and project d506ce8ca200496cbc15d09f49eab942. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:42:04.011615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:42:04.026740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:42:04.133373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6d79d945-79c4-472d-b021-cb1d5a064084 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.515688 Oct 24 13:42:04.134932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 24/43] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:42:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:42:04.147564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8e390766-38f3-4908-9eb5-b3cdc5745d28 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:04.149172 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8e390766-38f3-4908-9eb5-b3cdc5745d28 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:04.248085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] validate_networks() for [('051d9444-c9f6-450e-99dd-61dcbd128cbe', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:42:04.250202 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8e390766-38f3-4908-9eb5-b3cdc5745d28 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:04.262606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8e390766-38f3-4908-9eb5-b3cdc5745d28 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1222 microversion: 2.1 time: 0.120679 Oct 24 13:42:04.269737 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 25/44] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:04 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:04.749221 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:04.750128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:04.770105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:04.771593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:04.778936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:04.787626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:04.792257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:04.796028 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:05.207236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:05.240023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7c903ed1-7ecb-477a-9471-c756e7086aac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1290 microversion: 2.1 time: 0.494418 Oct 24 13:42:05.243647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 26/45] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:04 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1290 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:05.264838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:05.269019 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:05.289080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:05.291095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:05.292716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:05.295339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:05.296614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:05.298689 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:05.945932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:42:05.947537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:42:05.948212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:42:05.949700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:42:05.950328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:42:05.985972 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:05.990837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:05.993110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:05.994819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:06.003691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:06.009839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:06.109415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:42:06.119971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:42:06.151868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:42:06.167771 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:42:06.388349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78ac21c5-afda-415d-a3aa-6dbcbc98b04b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.456065 Oct 24 13:42:06.392506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 20/46] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:42:03 2022] POST /compute/v2.1/servers => generated 400 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:42:06.412298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:06.415754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:06.438403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:06.441064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:06.443598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:06.445076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:06.446214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:06.447251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:06.538560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:06.563426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d57c67e4-ad71-4901-8417-6a096ddc35fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1211 microversion: 2.1 time: 1.318428 Oct 24 13:42:06.568321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 27/47] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:05 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1211 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:06.590118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:06.606469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:06.645125 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:06.648730 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:06.649273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:06.651616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:06.656057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:06.656601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:06.831790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:06.841553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-220a218a-e569-42e4-8855-d120d4b8a5a1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1274 microversion: 2.1 time: 0.445918 Oct 24 13:42:06.844886 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 21/48] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:06 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1274 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:06.875196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7fcb2a31-d1f7-4ed7-a956-2cf6e2ceec99 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:06.876332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7fcb2a31-d1f7-4ed7-a956-2cf6e2ceec99 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:06.955206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:06.986064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9d77e770-6822-4e13-aed2-a4d44ebe9137 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1296 microversion: 2.1 time: 0.409932 Oct 24 13:42:07.000629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 28/49] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:06 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1296 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:07.087674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7fcb2a31-d1f7-4ed7-a956-2cf6e2ceec99 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:07.109667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7fcb2a31-d1f7-4ed7-a956-2cf6e2ceec99 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1241 microversion: 2.1 time: 0.259641 Oct 24 13:42:07.110963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 22/50] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:06 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1241 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:07.596653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:07.597318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:07.640858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:07.641366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:07.641825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:07.642680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:07.643146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:07.643575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:07.875681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:07.877545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:07.902414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:07.904166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:07.909557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:07.916793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:07.916793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:07.916793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:07.969843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:07.984894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3ee80b59-317e-406f-8f9c-33e850272796 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1273 microversion: 2.1 time: 0.391012 Oct 24 13:42:07.985860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 29/51] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:07 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1273 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:08.034495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:08.035393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:08.047943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.051823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.053325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.068503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.069434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.075585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.400676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:08.411530 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b5255575-7b56-482c-beee-d7b4ae4cd5c6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1296 microversion: 2.1 time: 0.386186 Oct 24 13:42:08.422611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 30/52] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:08 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1296 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:08.458922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:08.459587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:08.471679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.479030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.479948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.482534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:08.485076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:08.485704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:08.730267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:08.743314 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-83463e7e-b9a1-49c4-9fbc-1d14546fe808 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1292 microversion: 2.1 time: 0.874874 Oct 24 13:42:08.765312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 23/53] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:07 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1292 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:08.928036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:08.961775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-760fa2c2-e1fa-4e85-9875-3b1405734c57 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1237 microversion: 2.1 time: 0.522964 Oct 24 13:42:08.962448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 31/54] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:08 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1237 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:09.016911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:09.020069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:09.037871 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.040779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.042572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.043381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.047403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.049025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.451778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:09.452749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:09.469495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.470191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.470871 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.471799 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.472437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.473046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.676000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:09.688353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d9031a69-7afc-4e08-8731-47565a8341f8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1273 microversion: 2.1 time: 0.678982 Oct 24 13:42:09.690382 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 24/55] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:09 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1273 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:09.774501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:09.775205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:09.785454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.788939 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.789540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.791589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:09.792379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:09.795281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:09.851754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:09.860974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-54f0fbac-015e-41b5-810c-eb7182dcc130 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1296 microversion: 2.1 time: 0.414488 Oct 24 13:42:09.868463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 32/56] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:09 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1296 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:09.994558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:10.001126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:10.013395 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.016077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.017197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.020076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.023752 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.025673 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.037229 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:10.067248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-15c7cbf0-ff8d-4345-a73a-c2d4da3540b6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1280 microversion: 2.1 time: 0.295296 Oct 24 13:42:10.070422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 25/57] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:09 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1280 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:10.284694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:10.294650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4884562a-defe-443a-8b01-f0bf6dedb357 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1293 microversion: 2.1 time: 0.306205 Oct 24 13:42:10.299462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 33/58] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:09 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1293 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:10.722456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:10.723187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:10.747283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.748715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.770966 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.771954 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.773476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.775895 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.898753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:10.899647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:10.906830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.909247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.911683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:10.914199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:10.919084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:10.919749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.062615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:11.086963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-19cdc8a2-7dd4-4a32-994d-c0c8dbc6a2ee tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1273 microversion: 2.1 time: 0.369661 Oct 24 13:42:11.092119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 26/59] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:10 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:11.106614 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:11.107757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:11.130748 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.132359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.134031 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.138198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.139352 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.140975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.282433 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:11.305289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-565bc41e-240d-47b1-bed9-b455f3eb65e5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.410009 Oct 24 13:42:11.308825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 34/60] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:10 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:11.400807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:11.418410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d0035bc9-49a0-4ffb-b9bf-da250b93a04d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1280 microversion: 2.1 time: 0.322730 Oct 24 13:42:11.419096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 27/61] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:11 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:11.424679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:11.429182 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:11.442841 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.443329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.443764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.444462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.456025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.456514 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.554610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:11.569244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-47564b76-08ad-4df4-b474-dd99497d6a0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1293 microversion: 2.1 time: 0.148591 Oct 24 13:42:11.572469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 28/62] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:11 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:11.838489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ad3d9a-2678-43ea-a489-650efa93034c", "tag": "549a039c-6659-4a3a-835f-b4a69f84e5f7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:11.882257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.882751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.890954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.935563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Creating event network-changed:549a039c-6659-4a3a-835f-b4a69f84e5f7 for instance 40ad3d9a-2678-43ea-a489-650efa93034c on hv-cinder-86249 Oct 24 13:42:11.936658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 13:42:11.937203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da982e9d-b7a2-48a6-827c-6a66b4af8396 req-4e268a06-47e5-4b92-8be9-7a1d8b6915d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 13:42:11.938370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.939023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.939857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.940857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:11.941313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:11.941728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:11.953246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.compute.rpcapi [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 13:42:11.954564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] Releasing lock "compute-rpcapi-router" {{(pid=125457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 13:42:11.977271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6176dfcc-773a-4ee2-b273-169f55ef3e1b None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.667162 Oct 24 13:42:11.977883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 35/63] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:12.114579 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:12.115257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:12.131673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.132593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.133241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.136405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.136886 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.137319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.335958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:12.337506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:12.347012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.347799 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.348759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.353041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.353780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.354479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.379442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:12.396215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-521b0e0c-683f-4c8e-8f26-33c1a3b87ca5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.285510 Oct 24 13:42:12.397346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 29/64] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:12 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:12.447130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:12.450394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:12.459209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.460305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.461347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.462929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.463727 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.466305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.607912 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:12.630299 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e6fb843b-6d66-4e6d-ac34-643d5d2af8be tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.303624 Oct 24 13:42:12.632683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 36/65] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:12 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:12.639139 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:12.639751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:12.658526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.659653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.660089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.660821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:12.661344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:12.663176 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:12.730120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:12.741405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cfa79f4d-4597-439a-9932-26653286f859 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.301456 Oct 24 13:42:12.742487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 30/66] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:12 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:12.802904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:12.812455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-38420429-3378-499c-bc84-9e09293b1f2f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1293 microversion: 2.1 time: 0.178705 Oct 24 13:42:12.813532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 37/67] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:12 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1293 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:13.421026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:13.422384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:13.426888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:13.433681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:13.446350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:13.446807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:13.447582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:13.448012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:13.457866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:13.653326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:13.654202 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:13.667698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:13.672198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:13.672900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:13.674357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:13.688030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:13.691397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:13.879419 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:13.900637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-952c1deb-87e8-4096-81b7-4d7b6550e29b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.483137 Oct 24 13:42:13.901404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 31/68] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:13 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:13.913518 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:13.923079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:13.961740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:13.962824 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:13.963284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:13.964032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:13.964491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:13.964933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:14.133281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:14.140864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f8dadba5-cfff-415d-ab93-ea6f0a9b9eb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.491582 Oct 24 13:42:14.141445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 38/69] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:13 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:14.158936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:14.159554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:14.170925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:14.171672 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:14.172246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:14.173145 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:14.174359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:14.174969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:14.269017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=22 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:14.740224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:14.755873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4d4671a3-9d04-483c-a15d-45a9ea7484c5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1293 microversion: 2.1 time: 0.613326 Oct 24 13:42:14.762374 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 39/70] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:14 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1293 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:14.931646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:14.933935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:14.943821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:14.944458 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:14.954702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:14.955580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:14.956236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:14.956767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:15.589971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:15.599197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-99cb764b-ef54-4f3a-b44f-6f28f9d8778b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.672179 Oct 24 13:42:15.599776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 40/71] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:14 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:15.624916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:15.625542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:15.659185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:15.664425 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:15.665037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:15.666650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:15.667885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:15.671422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:16.051900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:16.219867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:16.228562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3d501243-285a-446c-919a-adeccac9a1e6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 2.325253 Oct 24 13:42:16.229171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 32/72] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:13 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:16.254864 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:16.266209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:16.275524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:16.280322 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:16.280941 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:16.281905 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:16.282553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:16.284085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:16.479887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:16.489441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f3b4a052-ce6b-46df-b00d-68fc0f259277 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.888623 Oct 24 13:42:16.506407 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 41/73] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:15 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:16.629818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:16.630633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:16.679033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:16.682046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:16.682987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:16.690501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:16.698897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:16.706026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:16.717445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:17.100060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=28 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:17.396938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:17.405791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c433c4bc-d1b4-4e5d-9257-1eda1cafa6c6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.781555 Oct 24 13:42:17.407012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 42/74] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:16 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:17.413188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:17.413960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:17.430047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:17.433788 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:17.435005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:17.435762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:17.437315 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:17.438232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:17.438848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:17.441608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8ae97e4c-b588-4990-ba90-79ff05b27b32 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1299 microversion: 2.1 time: 1.191959 Oct 24 13:42:17.452663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 33/75] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:16 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1299 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:17.517612 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:17.518464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:17.526430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:17.526906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:17.530952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:17.531740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:17.532259 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:17.532685 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:17.783898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:17.797638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ed61c932-15c2-401c-9158-9cac597e5e0a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.389365 Oct 24 13:42:17.800106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 43/76] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:17 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:17.928392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:17.956321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-132f20c6-7aa9-4bc9-868e-1d2f6b2c988a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.443117 Oct 24 13:42:17.973114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 34/77] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:17 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:18.436875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:18.438437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:18.446363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:18.447150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:18.447810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:18.448712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:18.449723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:18.450912 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:18.480522 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:18.481925 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:18.494323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:18.495877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:18.496995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:18.497947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:18.498629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:18.499367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:18.544968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:18.779343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:18.792718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-84604aa7-89b7-419b-a1e3-b9b25ad2177e tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.361059 Oct 24 13:42:18.799525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 44/78] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:18 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:18.833437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:18.834445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:18.848237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:18.849220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:18.849964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:18.850987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:18.851648 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:18.852414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:18.983480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:18.994530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6adbf0bc-fc57-4053-9576-e05d3db184e4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1299 microversion: 2.1 time: 0.521956 Oct 24 13:42:19.022001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 35/79] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:18 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1299 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:19.027920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:19.028596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:19.037850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:19.038459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:19.050726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:19.051632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:19.052350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:19.053046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:19.089079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:19.100185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7a3f59cf-e4cb-44f3-8309-9aab026a3ef3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.277335 Oct 24 13:42:19.131797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 45/80] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:18 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:19.838654 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:19.840448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:19.852424 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:19.854654 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:19.856318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:19.857938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:19.863111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:19.863805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:20.046867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:20.064160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a9643326-f299-42a0-b39d-f9b925b49c4a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.230542 Oct 24 13:42:20.065611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 46/81] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:19 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:20.071892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:20.073724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:20.080942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:20.083686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:20.084608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:20.085426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:20.086505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:20.087281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:20.088431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:20.227550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:20.238355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-106cfe51-219d-41e2-a75b-084633c8d2ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1299 microversion: 2.1 time: 0.170674 Oct 24 13:42:20.257447 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 47/82] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:20 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:20.263032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:20.263657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:20.272525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:20.273010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:20.273450 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:20.274153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:20.274632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:20.275083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:20.369636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:20.382392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-615d4f4b-673c-4a6c-ac45-6f2c9fcbde60 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 1.358836 Oct 24 13:42:20.383531 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 36/83] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:19 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:20.508540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:20.525294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f8f3036d-c6bb-43de-bc78-21da82951501 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.266310 Oct 24 13:42:20.526351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 48/84] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:20 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:21.098110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:21.098905 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:21.110154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.114536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.115608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.116801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.119303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.120884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.369224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-669fcec7-cc54-4321-b7c7-6083d3163449 req-75b07d78-83e1-49d4-adc5-14d4733a767e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bf2855-1081-401a-a540-af8ef43dc1c8", "tag": "bf5a05a5-0f38-47bd-8c1b-ac1cc249329b"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:21.390416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-669fcec7-cc54-4321-b7c7-6083d3163449 req-75b07d78-83e1-49d4-adc5-14d4733a767e service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.394981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-669fcec7-cc54-4321-b7c7-6083d3163449 req-75b07d78-83e1-49d4-adc5-14d4733a767e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.395575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-669fcec7-cc54-4321-b7c7-6083d3163449 req-75b07d78-83e1-49d4-adc5-14d4733a767e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.423428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-669fcec7-cc54-4321-b7c7-6083d3163449 req-75b07d78-83e1-49d4-adc5-14d4733a767e service nova] Creating event network-changed:bf5a05a5-0f38-47bd-8c1b-ac1cc249329b for instance b4bf2855-1081-401a-a540-af8ef43dc1c8 on hv-cinder-86249 Oct 24 13:42:21.430850 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-669fcec7-cc54-4321-b7c7-6083d3163449 req-75b07d78-83e1-49d4-adc5-14d4733a767e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187586 Oct 24 13:42:21.431987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 49/85] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:21.439984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:21.444451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:21.460686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.461328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.461767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.462580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.463103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.463866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.661867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:21.674432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1c8c3a1d-bf2d-4fa1-a6a8-e4d06011e315 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.586241 Oct 24 13:42:21.675966 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 37/86] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:21 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:21.682394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:21.683223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:21.709880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.710353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.710791 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.711505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.711955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.712378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.724586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:21.732993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f5b37138-64bf-4d21-b097-419c628bc72a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.298539 Oct 24 13:42:21.734418 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 50/87] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:21 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:21.740156 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:21.744339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:21.755291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.756055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.756911 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.757835 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:21.758525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:21.759782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:21.926868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:21.936719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8b052672-a7cf-48a0-bcc7-4d6580b16b60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.200985 Oct 24 13:42:21.938391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 51/88] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:21 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:21.979237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:21.988921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f3791011-f55e-4cc3-94f5-ec352aeb09b3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.311646 Oct 24 13:42:21.989660 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 38/89] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:21 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:22.701064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:22.701680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:22.703705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:22.719989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:22.720917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:22.721536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:22.722428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:22.723212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:22.723781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:22.762061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:22.763531 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:22.773963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:22.778931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:22.780058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:22.782090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:22.790867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:22.791530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:23.101937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:23.109522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-48d16d11-1dad-4d71-9fdb-f649118e742a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.412384 Oct 24 13:42:23.123312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 52/90] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:22 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:23.136122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:23.136946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:23.143207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:23.143937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:23.144562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:23.145471 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:23.146121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:23.147492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:23.227147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:23.245101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1df598ea-a462-45fe-bdc0-c90027dccc0b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.484625 Oct 24 13:42:23.249075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 39/91] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:22 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:23.254386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:23.257447 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:23.272014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:23.275911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:23.276613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:23.278330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:23.280263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:23.282058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:23.362330 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:23.371169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c866f2eb-d816-4d68-8546-e18aa5d58c27 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.246236 Oct 24 13:42:23.372711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 53/92] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:23 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:23.506838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372f925a-6a2d-47b9-b15c-b26dc8e87b27", "tag": "0c46907e-0420-4a7c-8e45-431a4ca82ddd"}, {"name": "network-changed", "server_uuid": "6c516707-ed3a-4bab-b73c-7d964cd4a782", "tag": "c1826e2d-fbef-4b42-9fa9-ce9952cb01e7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:23.521380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:23.529831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:23.530591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:23.531201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:23.541460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-303fcda8-a800-41c2-b8b8-3b8f1402209a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.291203 Oct 24 13:42:23.542110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 40/93] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:23 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:23.567512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] Creating event network-changed:0c46907e-0420-4a7c-8e45-431a4ca82ddd for instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 on hv-cinder-86249 Oct 24 13:42:23.568053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] Creating event network-changed:c1826e2d-fbef-4b42-9fa9-ce9952cb01e7 for instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 on hv-cinder-86249 Oct 24 13:42:23.580187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-69bb95a6-e237-4614-9dfa-97593e0dc137 req-f5ab7f5d-d877-43bb-b1d8-a45fd64cba02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078456 Oct 24 13:42:23.581947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 54/94] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:24.143041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:24.144394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:24.154614 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.155351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.156193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.157131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.159045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.160557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.272385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:24.274330 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:24.290917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.292873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.294055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.296375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.299520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.300600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.367561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:24.375538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5fcb4f39-0815-4704-99cd-2e6f07cf1e16 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.238640 Oct 24 13:42:24.386958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 41/95] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:24 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:24.400697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:24.401374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:24.408811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.409307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.409746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.410496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.410957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.411384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.461484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:24.473343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9f32502a-3ad5-410f-8b25-2ae058928b65 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.207272 Oct 24 13:42:24.473856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 55/96] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:24 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:24.568580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:24.569468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:24.579670 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:24.580463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.582871 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.583727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.585042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:24.585686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:24.587070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:24.589358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a097b865-f415-4d0b-ba75-6fc7f7d6bc92 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.193529 Oct 24 13:42:24.602635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 42/97] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:24 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:24.779302 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:24.788494 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-58bd9dff-da1e-4acb-930e-f7e4fb9f4a67 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.225546 Oct 24 13:42:24.789363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 56/98] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:24 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:25.408243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:25.410880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:25.421395 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.422112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.422890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.424502 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.425202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.425854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.496975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:25.497697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:25.506596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.507443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.508061 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.508951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.509635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.510417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.744664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:25.755294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6e208daa-6940-4e79-bc67-c210c3dc8a84 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.262154 Oct 24 13:42:25.771800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 57/99] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:25 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:25.793278 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-7924b328-1cd3-4c7d-9a2d-601570cff042 req-a0499464-89cf-4f62-b614-c18b7e06877b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafd3f2b-d38e-4889-aa12-0c584189083a", "tag": "3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:25.818089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-7924b328-1cd3-4c7d-9a2d-601570cff042 req-a0499464-89cf-4f62-b614-c18b7e06877b service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.818757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-7924b328-1cd3-4c7d-9a2d-601570cff042 req-a0499464-89cf-4f62-b614-c18b7e06877b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.819499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-7924b328-1cd3-4c7d-9a2d-601570cff042 req-a0499464-89cf-4f62-b614-c18b7e06877b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.844360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-7924b328-1cd3-4c7d-9a2d-601570cff042 req-a0499464-89cf-4f62-b614-c18b7e06877b service nova] Creating event network-changed:3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4 for instance dafd3f2b-d38e-4889-aa12-0c584189083a on hv-cinder-86249 Oct 24 13:42:25.853857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-7924b328-1cd3-4c7d-9a2d-601570cff042 req-a0499464-89cf-4f62-b614-c18b7e06877b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080240 Oct 24 13:42:25.855184 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 58/100] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:25.856449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:25.864498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:25.865466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:25.867646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-87cc791a-f97c-444e-b9da-791232ae5a9c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.469654 Oct 24 13:42:25.869192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 43/101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:25 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:25.875635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.876124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.890008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:25.891189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.891833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:25.893116 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.894920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.895378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.914751 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.915374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.915813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:25.916521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:25.923161 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:25.924833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.251080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:26.259993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d8fee22e-0fd9-466f-9460-36051851c5ad tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.403394 Oct 24 13:42:26.260575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 59/102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:25 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:26.581916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:26.592457 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bfda666a-b8a7-40a1-bbe8-c9f3839bdb96 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.720228 Oct 24 13:42:26.594505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 44/103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:25 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:26.784675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:26.785239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:26.795274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:26.795934 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:26.796716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.797575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:26.798110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:26.798785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.891206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:26.891912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:26.900058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:26.900688 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:26.901256 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.902143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:26.902626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:26.903048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:26.983209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:26.992362 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:26.995677 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-174ab588-c1c2-4ea6-88b9-73fe6644eeed tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.216400 Oct 24 13:42:26.996788 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 60/104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:26 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:27.103667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:27.115873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cd8e9ab8-c080-401c-9842-955c1de66707 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.228966 Oct 24 13:42:27.116786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 45/105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:26 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:27.284808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:27.285659 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:27.299485 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.301543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.302195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.304013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.304475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.306925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.462075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ad3d9a-2678-43ea-a489-650efa93034c", "name": "network-vif-plugged", "status": "completed", "tag": "549a039c-6659-4a3a-835f-b4a69f84e5f7"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:27.476370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.477162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.477589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.498253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Creating event network-vif-plugged:549a039c-6659-4a3a-835f-b4a69f84e5f7 for instance 40ad3d9a-2678-43ea-a489-650efa93034c on hv-cinder-86249 Oct 24 13:42:27.499343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 13:42:27.499866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-da603d90-5a15-4118-91ad-e37e657a2624 req-3e69cfdc-ebe9-4398-b854-5989d9eab65d service nova] Acquired lock "compute-rpcapi-router" {{(pid=125456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 13:42:27.501223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.502898 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.503588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.504516 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.505205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.505842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.516643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.compute.rpcapi [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 13:42:27.519494 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] Releasing lock "compute-rpcapi-router" {{(pid=125456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 13:42:27.556326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:27.562906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ffdeb26b-4c87-4c13-aedf-f935d0fe8f58 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170082 Oct 24 13:42:27.564553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 46/106] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:27.565781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-15769ec8-5009-4daf-8e25-67bad71017e4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.285990 Oct 24 13:42:27.571117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 61/107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:27 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:27.623659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:27.624366 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:27.632211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.632806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.633246 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.633942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:27.634411 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:27.634832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:27.811332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:27.820023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-59b4ec26-2312-4daf-a1b9-80a688d261f3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.200644 Oct 24 13:42:27.820785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 47/108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:27 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:28.024962 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:28.026415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:28.033451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.034525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.035471 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.036166 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.036822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.037481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.146224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:28.146975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:28.157726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.161318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.161824 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.162612 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.165691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.167047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.195547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:28.214523 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-71341840-c99a-4afd-abb8-5a010b09b64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.193764 Oct 24 13:42:28.218045 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 62/109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:28 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:28.405942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:28.413894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7d6ba642-ed2f-472b-a9ff-179f623f20c2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.273263 Oct 24 13:42:28.414497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 48/110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:28 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:28.589006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:28.589618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:28.597480 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.598251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.598701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.599416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.600029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.600443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.846735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:28.848374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:28.852710 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:28.862762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-931d5961-7fea-491c-aab2-a3bf886fe239 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.277511 Oct 24 13:42:28.865337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 63/111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:28 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:28.868561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.869049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.869482 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:28.870198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:28.870659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:28.871080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:29.241904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:29.243567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:29.249802 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:29.250323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:29.250761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:29.254137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:29.256721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:29.257614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:29.347968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:29.363550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-553c064d-7b4a-418c-943b-1bff1f647a0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.521323 Oct 24 13:42:29.364758 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 49/112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:28 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:29.436811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:29.437943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:29.452639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:29.453285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:29.453888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:29.455004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:29.455598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:29.456171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:29.739065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:29.755062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-38ff4074-7e86-4090-965c-545c7d761880 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.517429 Oct 24 13:42:29.755633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 64/113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:29 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:29.779217 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:29.799187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b8a4f90a-26e3-4333-b72c-0635bad3d231 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.362216 Oct 24 13:42:29.803443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 50/114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:29 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:29.891273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:29.892787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:29.903059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:29.903554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:29.904001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:29.909205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:29.909877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:29.910467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.114909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:30.124436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7d499e96-4770-4674-b4f4-eb2c29380417 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.237149 Oct 24 13:42:30.127783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 65/115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:29 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:30.390086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:30.390975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:30.397615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.398199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.398847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.399719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.400368 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.400969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.617027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:30.625916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-adebb4cd-d475-4b96-809b-2b610660a08d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.239812 Oct 24 13:42:30.626515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 51/116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:30 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:30.776609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:30.778032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:30.785734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.786243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.786675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.787354 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.787962 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.788384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.824562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:30.825372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:30.834734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.835222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.835652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.836343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:30.836783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:30.837201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:30.858920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:30.962403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:30.971626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-093dbb5f-aa33-4576-9b2e-a57b3b42a8d2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.198607 Oct 24 13:42:30.972364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 66/117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:30 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:31.009495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:31.018872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7c9d6937-6c3c-4c74-8a7c-8ba449d88374 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.198200 Oct 24 13:42:31.019901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 52/118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:30 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:31.148753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:31.149263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:31.156448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:31.156959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:31.158128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:31.159105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:31.159557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:31.159978 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:31.333821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:31.341723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-15925f76-dc6b-48d6-a133-67a175a7833f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.197085 Oct 24 13:42:31.342313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 67/119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:31 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:31.648788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:31.649454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:31.656147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:31.656546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:31.656972 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:31.657730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:31.658765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:31.659383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:31.804199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:31.813272 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-01776341-61e8-47c4-8b0e-4e8e69de3318 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.168201 Oct 24 13:42:31.815036 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 53/120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:31 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:31.995954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:31.997365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:32.005635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.006366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.006798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.007878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.008339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.008762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.042543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:32.043143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:32.053973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.054488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.054923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.055626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.056074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.056684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.181415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:32.191986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4cff2941-6e0b-400c-a4a7-77ad0937f1dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.199737 Oct 24 13:42:32.192724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 68/121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:31 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:32.259207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:32.270069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2fdf2954-ab95-42b9-bead-af843ec539d2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.231572 Oct 24 13:42:32.270778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 54/122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:32 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:32.368109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:32.369338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:32.379267 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.381651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.382908 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.383702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.384367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.384864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.541884 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:32.549661 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-22f9f1a4-98dc-40a4-9671-92e3ed93c4b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.188285 Oct 24 13:42:32.550239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 69/123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:32 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:32.836593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:32.837613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:32.843586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.844069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.844504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.845325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:32.845805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:32.846254 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:32.974267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:32.981752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b9aca7e3-b9f6-4b21-9704-bfc03fb1c0f4 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.149018 Oct 24 13:42:32.982365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 55/124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:32 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:33.215264 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:33.215878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:33.221864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.222372 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.222805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.223510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.223960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.224377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.297123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:33.297847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:33.305081 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.305627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.306260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.306947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.307463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.307948 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.355155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:33.363467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0b986865-069d-4658-9f7c-0de4f76aeb78 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.151956 Oct 24 13:42:33.364036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 70/125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:33 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:33.435742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:33.443640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bb8f97d2-a712-456d-91a0-564c7cfdc579 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.150667 Oct 24 13:42:33.444207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 56/126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:33 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:33.573370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:33.573978 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:33.579888 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.580363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.580794 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.581478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:33.581933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:33.582390 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:33.708167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:33.715740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-19c820d6-3cca-4b5c-b912-95cf2aef0034 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.146238 Oct 24 13:42:33.716300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 71/127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:33 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:34.005035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:34.005554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:34.011699 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.012191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.012626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.013319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.013775 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.014224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.142982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:34.150541 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-de7d1e7e-43de-4dab-833b-847f4edc6d54 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.149594 Oct 24 13:42:34.151113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 57/128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:33 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:34.385643 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:34.386306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:34.393232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.393815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.394317 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.395008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.395461 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.395879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.467076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:34.467687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:34.474538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.475454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.475454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.476092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.476563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.476954 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.535360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:34.544403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5f0b1132-61f8-4f56-862b-6a2b6edd55e6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.162513 Oct 24 13:42:34.554274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 72/129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:34 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:34.608467 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:34.617152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-25b34b59-ad16-4a83-97ca-c55fff2405a8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.153698 Oct 24 13:42:34.622353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 58/130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:34 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:34.738989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:34.739612 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:34.745648 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.746137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.746602 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.747293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.747758 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.748179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.780713 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-285687b3-4790-4e65-9e2d-174977252c33 req-7a3cbaf2-57e8-472d-810a-d3fd8548f641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafd3f2b-d38e-4889-aa12-0c584189083a", "name": "network-vif-plugged", "status": "completed", "tag": "3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:34.793359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-285687b3-4790-4e65-9e2d-174977252c33 req-7a3cbaf2-57e8-472d-810a-d3fd8548f641 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:34.795784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-285687b3-4790-4e65-9e2d-174977252c33 req-7a3cbaf2-57e8-472d-810a-d3fd8548f641 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:34.796438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-285687b3-4790-4e65-9e2d-174977252c33 req-7a3cbaf2-57e8-472d-810a-d3fd8548f641 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:34.811008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-285687b3-4790-4e65-9e2d-174977252c33 req-7a3cbaf2-57e8-472d-810a-d3fd8548f641 service nova] Creating event network-vif-plugged:3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4 for instance dafd3f2b-d38e-4889-aa12-0c584189083a on hv-cinder-86249 Oct 24 13:42:34.817740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-285687b3-4790-4e65-9e2d-174977252c33 req-7a3cbaf2-57e8-472d-810a-d3fd8548f641 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040860 Oct 24 13:42:34.819073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 59/131] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:34.883816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:34.891375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-68c54640-5a08-47df-87ef-f9927ef1a0df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.156625 Oct 24 13:42:34.891919 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 73/132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:34 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:35.174570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:35.175271 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:35.181372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.181845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.182305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.182983 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.183430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.183848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.312966 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:35.320979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-89106e3c-df91-4403-8468-a2781a89f9d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.151339 Oct 24 13:42:35.321543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 60/133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:35 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:35.569250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:35.569860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:35.575685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.576164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.576593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.577271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.577716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.578131 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.640296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:35.640914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:35.647722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.648191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.648626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.649320 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.649805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.650260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.709807 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:35.717600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d7a2d7f5-b018-41a8-be82-72dabaa7dc31 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.152099 Oct 24 13:42:35.718177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 74/134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:35 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:35.780330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:35.788345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3f0f15d1-5426-4dc2-8f49-f8f5a20645cc tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.151996 Oct 24 13:42:35.788900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 61/135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:35 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:35.914890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:35.915431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:35.921451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.922246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.922685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:35.923374 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:35.924406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:35.924840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.052629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:36.060246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fe04e63d-df1b-4ed3-9a85-c8ceff4564ca tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.149300 Oct 24 13:42:36.060805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 75/136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:35 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:36.343872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:36.344474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:36.351262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.351735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.352159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.352837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.353277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.353694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.482861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:36.491261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-44192765-0bf9-416f-84ee-bb2e3bd79d4b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.151147 Oct 24 13:42:36.491817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 62/137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:36 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:36.739734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:36.740274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:36.746114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.746608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.747029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.747697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.748139 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.748553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.811909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:36.812518 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:36.818987 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.819396 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.819828 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.820521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:36.820969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:36.821389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:36.881662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:36.889241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2e8440a3-989f-4e4b-82cc-d3cbb7405e73 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.153454 Oct 24 13:42:36.889804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 76/138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:36 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:36.952598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:36.960849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a2ca342b-ae49-4676-8d69-cc2c52e7f3d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.153354 Oct 24 13:42:36.961410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 63/139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:36 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:37.084704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:37.085315 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:37.091257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.091754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.092185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.092862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.093309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.093734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.112711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:37.221584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:37.229125 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-af30a040-87e0-4e76-a1c9-78cc4163cba6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.149179 Oct 24 13:42:37.229679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 77/140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:37 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:37.513829 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:37.514460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:37.516675 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:37.522427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.523026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.523499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.524202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.524651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.525076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.653806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:37.662296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-afe22584-b622-48ac-9513-981196715c05 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.152329 Oct 24 13:42:37.663018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 64/141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:37 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:37.913527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:37.914063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:37.919909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.920401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.920825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.921492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.921935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.922373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.983115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:37.983720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:37.990444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.990919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.991337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:37.992017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:37.992461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:37.992877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.054974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:38.062644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-04cb5535-c0f6-4786-8cb2-4b7a079b8155 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.154202 Oct 24 13:42:38.063201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 78/142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:37 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:38.127330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:38.135031 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f9442b2c-9002-4b16-91a2-8b7a9982446d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.155762 Oct 24 13:42:38.135569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 65/143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:37 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:38.251198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:38.251844 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:38.257806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:38.258329 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:38.258765 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.259446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:38.259896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:38.260323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.390051 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:38.398420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-555b5057-e458-4461-9ab8-b952ba5bb912 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.151014 Oct 24 13:42:38.398983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 79/144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:38 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:38.685729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:38.686362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:38.692961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:38.693446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:38.693873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.694589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:38.695042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:38.695468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:38.820169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:38.827689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6de3bf0f-0ec9-457b-a711-bae97656d9bb tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.145724 Oct 24 13:42:38.828254 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 66/145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:38 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:39.085721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:39.086355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:39.092141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.092612 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.093038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.093708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.094149 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.094585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.158324 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:39.159196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:39.165261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.165742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.166193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.166902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.167350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.167768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.225306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:39.233197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-86ce5aeb-3794-47a7-ae33-9186ea8a529e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.151175 Oct 24 13:42:39.241077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 80/146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:39 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:39.306314 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:39.313889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e22b8abd-912c-4a43-80d2-909ba91b6f6f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.159635 Oct 24 13:42:39.314582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 67/147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:39 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:39.420781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:39.421384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:39.428042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.428511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.428933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.429605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.430048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.430502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.560558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:39.568179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f1ceac76-f04b-4ded-b9da-28fd6d9ffb83 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.151283 Oct 24 13:42:39.568733 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 81/148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:39 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:39.852003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:39.852631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:39.858310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.858783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.859206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:39.859874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:39.860315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:39.860984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.036027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:40.043732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-79eccc5c-d1e3-4368-9b3d-82238197e8b6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.195686 Oct 24 13:42:40.044303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 68/149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:39 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:40.256283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:40.256897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:40.262880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:40.263526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:40.263961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.264679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:40.265135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:40.265560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.336820 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:40.337648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:40.343969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:40.344389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:40.345085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.345866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:40.346936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:40.347426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.409963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:40.420042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8f9f9b59-a654-4b85-9aa9-287b37eb9c26 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.167576 Oct 24 13:42:40.420909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 82/150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:40 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:40.487388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:40.490833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:40.495969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1d19465a-cd8b-4b68-99d0-abcdf35c63aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.162961 Oct 24 13:42:40.496526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 69/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:40 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:40.589754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:40.590400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:40.596901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:40.597594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:40.598027 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.598746 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:40.599203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:40.599629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:40.733008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:40.740615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9bbbcbce-f2ab-4e3b-a171-a8c50ee44ba9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.154536 Oct 24 13:42:40.741228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 83/152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:40 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:41.068667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:41.069303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:41.075213 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.075693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.076128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.076811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.077259 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.077684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.210990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:41.219601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ff2c2d1a-52ab-40bf-b5a0-7401c3fd92e8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.155373 Oct 24 13:42:41.220199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 70/153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:41 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:41.445337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:41.445868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:41.453059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.453457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.453886 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.454609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.455094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.455608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.519075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:41.519969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:41.526446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.527226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.527872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.528813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.529761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.531025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.614210 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:41.622568 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-99696420-de87-467a-be32-e785228ff1ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.181465 Oct 24 13:42:41.623491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 84/154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:41 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:41.669854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:41.679095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0cb5adaa-4586-4b45-bd33-aa1cef0058a2 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.163831 Oct 24 13:42:41.679995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 71/155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:41 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:41.763798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:41.764405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:41.770482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.770951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.771439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.772325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:41.772903 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:41.773327 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:41.969140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:41.977546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0a8798fa-d84a-4963-9408-278629e786d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.217932 Oct 24 13:42:41.978518 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 85/156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:41 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:42.241815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:42.242448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:42.250303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:42.250830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:42.251197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:42.251994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:42.252599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:42.253351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:42.391471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:42.400254 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6af8bbb6-e0d2-4192-b6fd-a38d7b2cadf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.162101 Oct 24 13:42:42.400912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 72/157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:42 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:42.646663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:42.647282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:42.653266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:42.654282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:42.654968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:42.655671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:42.656123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:42.656547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:42.703118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:42.703988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:42.710832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:42.711394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:42.711899 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:42.712722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:42.713245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:42.713743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:42.794106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:42.803712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0b600d48-27c2-4293-bffa-9d3f241ea6a4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.161566 Oct 24 13:42:42.804503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 86/158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:42 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:42.850190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:42.857903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4bfdb451-6f8b-4cd7-8b97-46912b8fb916 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.159610 Oct 24 13:42:42.858687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 73/159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:42 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:43.000775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:43.001381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:43.008513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.009000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.009434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.010128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.010644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.011193 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.157444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:43.171863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3b6245cc-5a9e-46ca-94a4-9500534b918f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.175104 Oct 24 13:42:43.172432 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 87/160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:42 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:43.423540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:43.424677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:43.430976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.431452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.431880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.432557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.433004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.433416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.570073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:43.578127 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-21137177-f758-46b4-b463-bc3737d12cc0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.158397 Oct 24 13:42:43.578803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 74/161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:43 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:43.831971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:43.833158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:43.839236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.839904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.840331 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.841025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.841469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.841885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.881766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:43.882399 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:43.884216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=87 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:43.889588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.890058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.890514 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.891198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:43.891646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:43.892065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:43.978552 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:43.986558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-71a98a30-ba91-411a-a786-bda38a2822ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.162479 Oct 24 13:42:43.987240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 88/162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:43 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:44.027160 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:44.035075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bfbb187f-f438-483c-90dc-a4bca80475c5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.157081 Oct 24 13:42:44.035631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 75/163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:43 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:44.194780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:44.196078 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:44.202292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:44.202773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:44.203269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:44.203866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:44.204308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:44.205248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:44.335753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:44.343243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3eaf4f06-0d42-4f03-843e-2b9eb8368be2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.152326 Oct 24 13:42:44.343796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 89/164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:44 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:44.601979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:44.602638 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:44.608555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:44.609029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:44.609459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:44.610137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:44.610614 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:44.611616 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:44.740947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:44.748509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-64074707-c6a4-4de9-bbbe-8be3402839ad tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.150293 Oct 24 13:42:44.749064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 76/165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:44 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:45.010045 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:45.010683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:45.016716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.017628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.018154 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.018835 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.019280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.019698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.057101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:45.057712 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:45.063692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.064174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.064602 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.065291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.065736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.066153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.148454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:45.156972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4d4f926c-1fe4-4cb6-86f9-e3c5f705e855 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.150681 Oct 24 13:42:45.157647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 90/166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:45 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:45.195142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:45.202894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-80abcc00-8177-49ff-8b12-16ca04abbc86 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.149572 Oct 24 13:42:45.203460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 77/167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:45 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:45.365913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:45.366936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:45.374793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.375355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.375843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.376538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.377234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.377793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.528826 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:45.538370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6d45936b-6ea3-41a8-873f-7ad407623b4d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.177072 Oct 24 13:42:45.547052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 91/168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:45 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:45.771045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:45.771718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:45.777590 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.778067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.778534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.779217 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:45.779672 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:45.780094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:45.922463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:45.938621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c43287be-a694-478f-b392-fc0449e07b6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.171715 Oct 24 13:42:45.939428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 78/169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:45 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:46.170554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-f99fa4db-9ce9-4bc2-8f9a-40cd28cdbd7d req-bbb459f3-f59d-4484-8371-e41c2148974e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372f925a-6a2d-47b9-b15c-b26dc8e87b27", "name": "network-vif-plugged", "status": "completed", "tag": "0c46907e-0420-4a7c-8e45-431a4ca82ddd"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:46.180567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f99fa4db-9ce9-4bc2-8f9a-40cd28cdbd7d req-bbb459f3-f59d-4484-8371-e41c2148974e service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.180919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:46.181071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f99fa4db-9ce9-4bc2-8f9a-40cd28cdbd7d req-bbb459f3-f59d-4484-8371-e41c2148974e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.181497 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f99fa4db-9ce9-4bc2-8f9a-40cd28cdbd7d req-bbb459f3-f59d-4484-8371-e41c2148974e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.181595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:46.188654 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.189738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.190285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.190988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.191743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.192177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.193380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-f99fa4db-9ce9-4bc2-8f9a-40cd28cdbd7d req-bbb459f3-f59d-4484-8371-e41c2148974e service nova] Creating event network-vif-plugged:0c46907e-0420-4a7c-8e45-431a4ca82ddd for instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 on hv-cinder-86249 Oct 24 13:42:46.198575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-f99fa4db-9ce9-4bc2-8f9a-40cd28cdbd7d req-bbb459f3-f59d-4484-8371-e41c2148974e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Oct 24 13:42:46.199527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 92/170] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:42:46.227645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:46.228473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:46.234716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.235271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.235918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.237287 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.237830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.238340 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.351313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:46.358901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-86f3cd29-5684-4cf3-a1f9-11dba11ae6b2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.182200 Oct 24 13:42:46.359463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 79/171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:46 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:46.375708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:46.384177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f5e84974-b99c-4191-9f50-8eb859b6c8d6 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.160884 Oct 24 13:42:46.384736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 93/172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:46 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:46.564792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:46.565394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:46.571350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.571828 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.572253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.572964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.573375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.573766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.714641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:46.723167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-903c7a62-1bed-45b3-8c54-07f289b2f856 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.162756 Oct 24 13:42:46.723736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 80/173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:46 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:46.967253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:46.967857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:46.974740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.975219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.975641 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:46.976324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:46.976815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:46.977175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.112263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:47.115824 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:47.120930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cf2fbf5e-1752-4db5-91d1-3e967ef80c80 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.157452 Oct 24 13:42:47.127997 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 94/174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:46 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:47.381903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:47.382486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:47.388586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:47.389057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:47.389479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.390151 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:47.390632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:47.391047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.407633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:47.409196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:47.415275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:47.415797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:47.416234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.416927 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:47.417398 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:47.417804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.523693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:47.531307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ce11a2a4-8328-43cf-a3a7-bd4778f0eda4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.153299 Oct 24 13:42:47.531873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 81/175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:47 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:47.549276 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:47.556771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-876a857b-89fa-44f3-a2cd-2155be75542f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.153148 Oct 24 13:42:47.557326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 95/176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:47 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:47.744642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:47.745249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:47.751388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:47.752411 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:47.752859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.753534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:47.753978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:47.754421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:47.880650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:47.888234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-875a5969-3188-47d3-921a-13b8b6064a1e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.147408 Oct 24 13:42:47.888797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 82/177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:47 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:48.144233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:48.144965 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:48.151091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.151657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.152160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.152922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.153445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.153953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.291657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:48.300022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-05cb0a78-8345-42b2-831e-7fe4805ab541 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.159623 Oct 24 13:42:48.300692 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 96/178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:48 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:48.554716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:48.555329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:48.561527 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.562000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.562462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.563140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.563586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.564521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.580767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:48.581516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:48.584446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:48.588321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.588802 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.589258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.589912 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.590405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.590825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.698994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:48.706800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9cb4cf21-5bbb-4c41-af5c-470a3815f0b1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.155834 Oct 24 13:42:48.714261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 83/179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:48 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:48.724069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:48.732359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9d4f13d5-8b9b-4b3b-8381-01267f69d651 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.156100 Oct 24 13:42:48.732920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 97/180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:48 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:48.913469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:48.914142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:48.920639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.921116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.921550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:48.922260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:48.922710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:48.923128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.050060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:49.057865 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4302737e-458b-4ea1-a41b-ec9c721878b7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.150131 Oct 24 13:42:49.058466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 84/181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:48 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:49.323526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:49.324143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:49.330204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:49.330695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:49.331126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.331806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:49.332257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:49.332676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.458029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:49.465743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2d4ceafe-3580-40c7-88fc-28155fea5c0c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.146112 Oct 24 13:42:49.466271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 98/182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:49 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:49.729179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:49.729724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:49.735658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:49.736132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:49.736563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.737245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:49.737688 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:49.738107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.755494 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:49.756115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:49.762029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:49.762578 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:49.763013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.763705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:49.764187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:49.764605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:49.870868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:49.879034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e456f80b-e139-43a8-934e-d6d1fa5c46f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.153710 Oct 24 13:42:49.879599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 85/183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:49 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:49.897521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:49.905116 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6f82035c-0f02-4d99-9cac-c417995f4783 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.153721 Oct 24 13:42:49.905671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 99/184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:49 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:50.080536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:50.081145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:50.087181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.087651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.088103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.088776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.089220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.089635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.108868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:50.223386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:50.231041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-09163639-3e4d-4faf-a849-df591d22eece tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.154794 Oct 24 13:42:50.231601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 86/185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:50 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:50.488708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:50.489307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:50.495188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.495666 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.496094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.496767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.497214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.497629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.625025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:50.633188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-473c2855-ff7b-4dab-b36d-fa6657beb62b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.148300 Oct 24 13:42:50.633747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 100/186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:50 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:50.902683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:50.903291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:50.910302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.910934 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.911534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.912310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.912892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.913565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.929100 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:50.929717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:50.935596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.936071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.936503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:50.937195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:50.937644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:50.938063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:51.046174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:51.054435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-70be7e19-ee43-4bd0-99fa-a9675b93eec6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.155839 Oct 24 13:42:51.055017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 87/187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:50 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:51.067831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:51.081389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2130409d-657d-4a1f-8c2d-399b45a64c06 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.155846 Oct 24 13:42:51.082530 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 101/188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:50 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:51.253078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:51.253689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:51.259535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:51.260070 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:51.260593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:51.261444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:51.262007 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:51.262546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:51.392037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:51.400392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f2ddb478-a161-4988-ba55-4c240ea76460 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.151404 Oct 24 13:42:51.400967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 88/189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:51 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:51.656878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:51.657476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:51.664057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:51.664529 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:51.664957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:51.665649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:51.666177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:51.666604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:51.817250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:51.825363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e47b362c-8965-49ea-8ea4-77b79fd18dcd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.172381 Oct 24 13:42:51.838187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 102/190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:51 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:52.079086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:52.079690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:52.086106 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.087022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.087668 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.088566 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.089012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.089450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.124884 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:52.129959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:52.144128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.145273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.145690 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.146521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.146959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.150205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.251510 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:52.265644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fb1d6f90-00dd-4bc5-b6d4-455423c5fa0d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.191077 Oct 24 13:42:52.266501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 89/191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:52 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:52.313337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:52.322775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1076868a-66af-48bc-b23c-50cf07ec9d28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.213441 Oct 24 13:42:52.323428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 103/192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:52 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:52.423511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:52.425041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:52.432029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.432607 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.433137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.434076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.434898 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.435420 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.604028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:52.613406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3f97f29d-1acf-4094-9e0f-a0f16002766d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.193929 Oct 24 13:42:52.614111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 90/193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:52 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:52.849864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:52.862604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:52.863428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.863907 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.864344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:52.865334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:52.865909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:52.866408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:53.008856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:53.017854 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1befca39-6bfc-4589-a667-9a1b40fcd6ab tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.172977 Oct 24 13:42:53.018957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 104/194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:52 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:53.290698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:53.291298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:53.297811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:53.298304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:53.298998 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:53.299832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:53.300332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:53.300766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:53.352454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:53.353584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:53.362449 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:53.363127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:53.363702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:53.364538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:53.365176 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:53.365734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:53.482990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:53.492221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0f619ebe-03cb-4515-80e7-5d2dae594813 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.205729 Oct 24 13:42:53.493170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 91/195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:53 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:53.521384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:53.530627 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-435ff364-07db-455c-bb5a-f016abc60b34 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.181742 Oct 24 13:42:53.531333 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 105/196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:53 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:53.639132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:53.639831 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:53.646284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:53.646848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:53.647347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:53.648037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:53.648486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:53.648907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.008286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:54.016994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f75b01cb-75ec-4e09-8007-e150e8148c47 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.381553 Oct 24 13:42:54.020961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 92/197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:53 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:54.048200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:54.049220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:54.059289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.059852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.060577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.062079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.062830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.063877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.133615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-d2b38740-d752-4f8b-9da3-934f518b855f req-28b3fb00-502c-476c-ab5b-ace9e15797ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bf2855-1081-401a-a540-af8ef43dc1c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf5a05a5-0f38-47bd-8c1b-ac1cc249329b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:42:54.159221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d2b38740-d752-4f8b-9da3-934f518b855f req-28b3fb00-502c-476c-ab5b-ace9e15797ea service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.162397 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d2b38740-d752-4f8b-9da3-934f518b855f req-28b3fb00-502c-476c-ab5b-ace9e15797ea service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.163049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d2b38740-d752-4f8b-9da3-934f518b855f req-28b3fb00-502c-476c-ab5b-ace9e15797ea service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.181852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-d2b38740-d752-4f8b-9da3-934f518b855f req-28b3fb00-502c-476c-ab5b-ace9e15797ea service nova] Creating event network-vif-plugged:bf5a05a5-0f38-47bd-8c1b-ac1cc249329b for instance b4bf2855-1081-401a-a540-af8ef43dc1c8 on hv-cinder-86249 Oct 24 13:42:54.196556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-d2b38740-d752-4f8b-9da3-934f518b855f req-28b3fb00-502c-476c-ab5b-ace9e15797ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066535 Oct 24 13:42:54.197454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 93/198] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:42:54.267794 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:54.276597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e18e495d-4cfe-4f8c-895a-bca864a815b1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.232457 Oct 24 13:42:54.277448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 106/199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:54 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:54.519872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:54.520964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:54.533211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.535037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.536109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.537031 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.538157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.539091 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.559388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:54.561763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:54.573286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.575400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.576046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.578325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:54.584431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:54.584883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:54.762903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:54.768474 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:54.776481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4a63677c-05e5-46fa-b7bc-9e4ba656a581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.225688 Oct 24 13:42:54.777104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 107/200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:54 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:54.779429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-172f45c9-443e-45f7-a06e-c0039bb80703 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.265153 Oct 24 13:42:54.791727 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 94/201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:54 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:55.049417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:55.050435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:55.058304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.059093 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.059716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.061576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.062249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.062922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.226686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:55.235167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5d9e6aa9-7123-4162-a15a-53d464c686a5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.192327 Oct 24 13:42:55.246725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 108/202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:55 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:55.300858 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:55.301459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:55.307291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.308107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.308720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.309410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.310036 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.310684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.527630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:55.537590 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b60535d6-6e24-4c1a-ba03-292d88f72054 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.240535 Oct 24 13:42:55.538199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 95/203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:55 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:55.802207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:55.803205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:55.803666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:55.803933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:55.810542 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.811466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.811777 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.812044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.812277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.812715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.813420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.813878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.815018 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.816125 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:55.816915 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:55.817341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:55.962790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:55.973707 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7cbba2ef-22f2-4e31-87a0-fb174d19732a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.178058 Oct 24 13:42:55.978249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 109/204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:55 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:55.991853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:56.000028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a6d3421a-598e-45e1-806a-a66f50e45dda tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.201959 Oct 24 13:42:56.000597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 96/205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:55 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:56.261816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:56.262517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:56.270940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:56.271738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:56.272258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:56.273053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:56.273840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:56.274390 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:56.432782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:56.441451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1c6225b4-ed77-488b-acda-3fd0c7cd73c6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.186101 Oct 24 13:42:56.442031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 110/206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:56 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:56.565019 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:56.576083 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:56.584611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:56.590774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:56.591313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:56.592041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:56.595422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:56.595422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:56.765655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:56.774610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-207353b7-730f-4651-af76-25e41788dc22 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.214108 Oct 24 13:42:56.775528 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 97/207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:56 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:56.997618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:56.998396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:57.005310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.005802 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.006269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.006967 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.007419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.007854 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.024130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:57.024805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:57.031355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.032547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.033558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.034294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.034872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.035498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:42:57.036120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.152898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:57.161309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-56cb97ba-f956-42e2-9133-e0002999b650 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.167409 Oct 24 13:42:57.162025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 111/208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:56 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:57.203255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:57.213191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e8b836a1-20da-4f8d-8664-1c7975831d00 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.192774 Oct 24 13:42:57.214017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 98/209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:57 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:57.464627 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:57.465229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:57.471396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.471889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.472326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.473014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.473466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.474074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.620036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:57.627941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-25bf662f-34af-4496-9ace-fbe0bbf605bc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.167048 Oct 24 13:42:57.628506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 112/210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:57 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:57.798841 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:57.799507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:57.805704 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.806195 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.806637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.807316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:57.807763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:57.808176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:57.944341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:57.951837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c692390d-b01c-4a32-a869-5f87d4a8e6b2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.156966 Oct 24 13:42:57.952580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 99/211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:57 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:58.185493 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:58.186215 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:58.196141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.196635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.197069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.197761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.198262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.198683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.236862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:58.237893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:58.244929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.245571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.246569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.247482 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.248069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.248743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.338320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:58.347004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6cb6a8ca-d748-4217-ab56-15bcc0d657c4 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.165243 Oct 24 13:42:58.347571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 113/212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:58 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:58.393131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:58.401185 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-807ef03b-68d4-4bc5-9e96-c24d3f2f9477 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.168136 Oct 24 13:42:58.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 100/213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:58 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:58.650635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:58.651333 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:58.657186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.662337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.662337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.662337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.662337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.662702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.807266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:58.815597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-759c6590-1af0-4c52-b5a0-396ab816b366 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.169223 Oct 24 13:42:58.816167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 114/214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:58 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:58.976486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:58.977711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:58.990003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.990507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.992673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:58.994428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:58.994911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:58.995345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:59.240586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:59.248511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1763c634-1701-49dc-ba6c-7555da307dd2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.276385 Oct 24 13:42:59.249073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 101/215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:58 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:59.370053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:59.370776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:59.377793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:59.378305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:59.378744 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:59.379436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:59.379890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:59.380311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:59.424357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:59.424971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:59.432124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:59.432650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:59.433084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:59.435329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:59.436079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:59.436920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:59.529955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:59.539568 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ad7aef61-68bd-4ddd-8d15-1e2821f7ff8f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.173177 Oct 24 13:42:59.540157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 115/216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:59 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:42:59.584705 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:42:59.593114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-33d3445b-b942-4991-877c-d0a946336279 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.173170 Oct 24 13:42:59.593683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 102/217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:59 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:42:59.840683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:42:59.840683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:42:59.847940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:59.848530 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:59.849337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:42:59.850420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:42:59.851595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:42:59.852560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.004230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:00.013377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e36b1430-f5b3-4c60-959d-7e1d12d16eed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.178089 Oct 24 13:43:00.013949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 116/218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:42:59 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:00.272409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:00.273163 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:00.279150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:00.279633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:00.280069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.280754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:00.281209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:00.281631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.421444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:00.425308 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:00.430293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-82ead6e9-1e6a-40fb-ac0c-00b7ac40acf1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.161763 Oct 24 13:43:00.431037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 103/219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:00 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:00.562305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:00.562916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:00.570006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:00.570538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:00.570948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.571643 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:00.572096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:00.572522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.616744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:00.617354 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:00.623847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:00.624376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:00.625000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.625687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:00.626132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:00.627082 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:00.739639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:00.747637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-eab28b09-ac6a-4c51-bdec-6100d618f81d tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.189204 Oct 24 13:43:00.748203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 117/220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:00 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:00.798283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:00.806355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-adb96629-8a7f-4a2f-80d3-d81a2c319f30 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.193880 Oct 24 13:43:00.807076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 104/221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:00 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:01.037723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:01.038434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:01.044437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.044576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.044997 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.045750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.046307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.046740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.212208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:01.223756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-723df777-d7c5-4352-9167-419f537f9edf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.190777 Oct 24 13:43:01.224676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 118/222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:01 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:01.455516 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:01.456512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:01.464376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.465171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.465877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.466974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.467729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.468435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.618874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:01.626677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-47dc1a5a-e69a-4364-9036-023e42bd9df7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.176429 Oct 24 13:43:01.627248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 105/223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:01 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:01.770561 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:01.771266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:01.777213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.777716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.778292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.779006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.779618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.780031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.831834 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:01.832610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:01.839449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.839971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.840354 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.841202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:01.841636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:01.842056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:01.921219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:01.929467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-df416379-dc8b-4d2c-9c8e-6918e51c58f0 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.163157 Oct 24 13:43:01.930043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 119/224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:01 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:02.025936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:02.034774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-27e950d0-4ee3-47f1-927b-780ac76331a6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.208776 Oct 24 13:43:02.035342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 106/225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:01 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:02.246662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:02.247271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:02.254081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:02.254747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:02.255178 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:02.255860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:02.256304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:02.256860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:02.389698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:02.397706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-db2486f0-2ac5-4368-8eab-c3b26075c4db tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.154868 Oct 24 13:43:02.398299 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 120/226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:02 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:02.648807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:02.649418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:02.656056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:02.656545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:02.656981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:02.658201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:02.658902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:02.659326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:02.789674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:02.798137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d5510b89-b94a-4a2e-b737-dc2b0509ff51 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.153034 Oct 24 13:43:02.799405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 107/227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:02 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:02.952908 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:02.953795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:02.961257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:02.961738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:02.962195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:02.962864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:02.963312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:02.963726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.057920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:03.058777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:03.065409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:03.065981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:03.066481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.067278 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:03.067815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:03.068460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.100951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:03.112431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0a29b944-35f1-424c-97ac-595f95a1b694 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.163305 Oct 24 13:43:03.114849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 121/228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:02 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:03.207840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:03.215501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-826670c7-bd6f-4e9a-8abd-bd9958bccd2c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.162156 Oct 24 13:43:03.216069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 108/229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:03 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:03.420145 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:03.420747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:03.426723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:03.427192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:03.427616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.428282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:03.428728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:03.429140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.558585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:03.568836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-40c164a1-5284-41b2-a526-feaafc4878ee tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.152326 Oct 24 13:43:03.569725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 122/230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:03 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:03.821340 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:03.821958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:03.827953 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:03.828435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:03.828868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.829587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:03.830158 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:03.830806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:03.962635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:03.971497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c41f143a-72e5-4d81-b24d-f9529abf516f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.154104 Oct 24 13:43:03.972800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 109/231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:03 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:04.140745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:04.141357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:04.147818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:04.148230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:04.148691 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:04.149310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:04.149765 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:04.150207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:04.239162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:04.239929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:04.245790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:04.246428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:04.246868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:04.247589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:04.248043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:04.248467 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:04.276833 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:04.285367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-93e1a65f-cc2f-47b5-9da1-ca0d3820c9fe tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.148443 Oct 24 13:43:04.285936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 123/232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:04 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:04.376862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:04.385719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d4b9d803-5c46-4b30-8383-6690a5c94af1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.151062 Oct 24 13:43:04.386770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 110/233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:04 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:04.592013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:04.592621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:04.598550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:04.599031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:04.599468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:04.600147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:04.600601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:04.601024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:04.736722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:04.744467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2620c92c-c59a-4853-833f-7f0ea04cc404 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.156237 Oct 24 13:43:04.745031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 124/234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:04 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:04.994662 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:04.995623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:05.002485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.002973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.003409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.004099 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.004548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.005208 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.159381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:05.169674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-64447da0-6266-4cd7-ba95-3ffd4303a8ba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.178477 Oct 24 13:43:05.170479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 111/235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:04 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:05.310135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:05.311195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:05.318531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.319015 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.319446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.320532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.320990 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.321406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.409149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:05.409756 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:05.415683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.416154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.416604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.417281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.417788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.418222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.457599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:05.466787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-520561e7-e9b3-4654-94f8-b8f1c6c75e9b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.161823 Oct 24 13:43:05.467363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 125/236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:05 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:05.554371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:05.563048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-993dbb15-1668-48ac-842e-39511da48ef1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.158082 Oct 24 13:43:05.563655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 112/237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:05 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:05.712343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-ad29ba6f-ec5f-4062-9dff-7a0751fdfbb4 req-5de1d64c-aa0a-4685-8267-485a83643767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c516707-ed3a-4bab-b73c-7d964cd4a782", "name": "network-vif-plugged", "status": "completed", "tag": "c1826e2d-fbef-4b42-9fa9-ce9952cb01e7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:05.722582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ad29ba6f-ec5f-4062-9dff-7a0751fdfbb4 req-5de1d64c-aa0a-4685-8267-485a83643767 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.723052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ad29ba6f-ec5f-4062-9dff-7a0751fdfbb4 req-5de1d64c-aa0a-4685-8267-485a83643767 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.723520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ad29ba6f-ec5f-4062-9dff-7a0751fdfbb4 req-5de1d64c-aa0a-4685-8267-485a83643767 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.734946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-ad29ba6f-ec5f-4062-9dff-7a0751fdfbb4 req-5de1d64c-aa0a-4685-8267-485a83643767 service nova] Creating event network-vif-plugged:c1826e2d-fbef-4b42-9fa9-ce9952cb01e7 for instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 on hv-cinder-86249 Oct 24 13:43:05.741425 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-ad29ba6f-ec5f-4062-9dff-7a0751fdfbb4 req-5de1d64c-aa0a-4685-8267-485a83643767 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032533 Oct 24 13:43:05.742426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 126/238] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:05.767908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:05.768690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:05.774580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.775063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.775494 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.776181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:05.776634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:05.777057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:05.909274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:05.917552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-14d2e6da-eec4-4119-bfe2-f9cd79261f60 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.153599 Oct 24 13:43:05.918117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 113/239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:05 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:06.193875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:06.194911 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:06.201380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.201867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.202337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.203037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.203491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.203915 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.358613 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:06.370195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-368518df-d912-409f-9a7a-9ae5ea94537b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1364 microversion: 2.1 time: 0.180363 Oct 24 13:43:06.370858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 127/240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:06 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:06.489567 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:06.490247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:06.501105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.501105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.501105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.502422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.502880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.504406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.588591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:06.589587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:06.603879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.604373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.604938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.605642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.608513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.610917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.699143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:06.723662 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-05203206-a4d9-46b3-b034-afade0aad5fd tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.237783 Oct 24 13:43:06.727203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 114/241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:06 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:06.811283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:06.816375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:06.822049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-71e5a041-3105-4fe4-9de6-ce16150959cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1365 microversion: 2.1 time: 0.237792 Oct 24 13:43:06.838048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 128/242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:06 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:06.946809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:06.948950 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:06.962072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.963624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.964650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:06.967819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:06.968663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:06.969437 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.120608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:07.129149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78d6b7c7-6e63-4f15-8aec-cf483b7ca62e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.192294 Oct 24 13:43:07.129707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 115/243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:06 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:07.396379 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:07.396973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:07.406336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.406840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.407290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.408493 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.408970 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.409467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.542938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:07.551559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b18ac311-8be8-450a-8afd-ecb46a9430ac tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1551 microversion: 2.1 time: 0.159855 Oct 24 13:43:07.552143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 129/244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:07 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:07.574956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:07.575413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:07.581889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.582441 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.582878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.583578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.584039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.584466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.702582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-80827437-bca7-445d-b8fd-37a0ed21b402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131406 Oct 24 13:43:07.703268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 116/245] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:43:07 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:07.751323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:07.752452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:07.759303 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.760008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.760452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.761151 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.761606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.762033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.848387 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:07.850504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:07.861094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.861856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.862468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:07.863253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:07.863774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:07.864413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:08.129289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:08.138588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c41eac92-6f4c-431e-a7d1-db651c7cb42f tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.391861 Oct 24 13:43:08.152864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 130/246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:07 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:08.162937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:08.163655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:08.170533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:08.171284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:08.172105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:08.173108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:08.174609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:08.175254 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:08.439618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:08.449450 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-85b8a1de-ff7f-46bd-a89f-8004ac610951 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1322 microversion: 2.1 time: 0.294703 Oct 24 13:43:08.456631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 131/247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:08 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:08.469842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:08.480151 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1bdacfda-647a-445b-9839-56a06c9fdda0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1554 microversion: 2.1 time: 0.638644 Oct 24 13:43:08.501085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 117/248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:07 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1554 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:08.509094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:08.509556 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:08.515990 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:08.516701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:08.517373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:08.518335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:08.518991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:08.519610 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:08.675572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7cac0b4d-d7a7-4412-9a1f-9f9547158911 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170709 Oct 24 13:43:08.676854 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 132/249] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:43:08 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:09.167263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:09.167870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:09.174584 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:09.175291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:09.175873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:09.185759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:09.186588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:09.187175 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:09.481589 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:09.482224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:09.489315 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:09.489808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:09.490278 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:09.502357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:09.503081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:09.503538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:09.774923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:09.802636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ba00b1ef-b64b-4b2a-b5bd-344b24c1a022 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.638668 Oct 24 13:43:09.816803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 118/250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:09 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:09.872634 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:09.882392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-37c9e4c8-3674-4138-8c8d-73dc5fa58ce7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1515 microversion: 2.1 time: 0.404856 Oct 24 13:43:09.886870 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 133/251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:09 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1515 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:09.916020 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:09.920009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:09.928923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:09.930112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:09.930725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:09.931597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:09.932214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:09.932782 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:10.311057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'flavor' on Instance uuid 372f925a-6a2d-47b9-b15c-b26dc8e87b27 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:43:10.398998 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:10.495429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78475dad-19c1-4c54-b39f-ff3b12814d62 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27/action" status: 200 len: 32 microversion: 2.1 time: 0.586140 Oct 24 13:43:10.497021 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 119/252] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:43:09 2022] POST /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27/action => generated 32 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:43:10.506291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:10.507861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:10.514001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:10.516370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:10.517625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:10.518785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:10.519394 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:10.519992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:10.749834 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-ac057709-d442-4854-9bea-69436f175791 req-ce76486c-2707-4155-97b0-bf5c60ec5662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bf2855-1081-401a-a540-af8ef43dc1c8", "tag": "bf5a05a5-0f38-47bd-8c1b-ac1cc249329b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:10.764623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ac057709-d442-4854-9bea-69436f175791 req-ce76486c-2707-4155-97b0-bf5c60ec5662 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:10.765473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ac057709-d442-4854-9bea-69436f175791 req-ce76486c-2707-4155-97b0-bf5c60ec5662 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:10.768187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ac057709-d442-4854-9bea-69436f175791 req-ce76486c-2707-4155-97b0-bf5c60ec5662 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:10.781303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-ac057709-d442-4854-9bea-69436f175791 req-ce76486c-2707-4155-97b0-bf5c60ec5662 service nova] Creating event network-changed:bf5a05a5-0f38-47bd-8c1b-ac1cc249329b for instance b4bf2855-1081-401a-a540-af8ef43dc1c8 on hv-cinder-86249 Oct 24 13:43:10.793988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-ac057709-d442-4854-9bea-69436f175791 req-ce76486c-2707-4155-97b0-bf5c60ec5662 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054539 Oct 24 13:43:10.797308 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 120/253] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:43:10.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:10.836490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:10.855367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:10.859793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:10.862000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:10.864241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:10.864717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:10.865148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:11.015517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:11.054983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f9fbc9d2-71f1-471b-9077-5974e6297479 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.552394 Oct 24 13:43:11.080215 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 134/254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:10 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:11.087713 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-0bf0410a-76d8-403d-9dfb-ad8a08d76eda req-63faa80a-0c31-42da-af25-6a223d46eb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafd3f2b-d38e-4889-aa12-0c584189083a", "tag": "3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:11.164743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-0bf0410a-76d8-403d-9dfb-ad8a08d76eda req-63faa80a-0c31-42da-af25-6a223d46eb5b service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:11.166786 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-0bf0410a-76d8-403d-9dfb-ad8a08d76eda req-63faa80a-0c31-42da-af25-6a223d46eb5b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:11.168176 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-0bf0410a-76d8-403d-9dfb-ad8a08d76eda req-63faa80a-0c31-42da-af25-6a223d46eb5b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:11.207001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-0bf0410a-76d8-403d-9dfb-ad8a08d76eda req-63faa80a-0c31-42da-af25-6a223d46eb5b service nova] Creating event network-changed:3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4 for instance dafd3f2b-d38e-4889-aa12-0c584189083a on hv-cinder-86249 Oct 24 13:43:11.219769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-0bf0410a-76d8-403d-9dfb-ad8a08d76eda req-63faa80a-0c31-42da-af25-6a223d46eb5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135561 Oct 24 13:43:11.224532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 135/255] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:11.462102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:11.471418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9c8bf427-e180-4b4a-ba4d-f631ea9d98c8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1315 microversion: 2.1 time: 0.644706 Oct 24 13:43:11.474813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 121/256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:10 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:12.084548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:12.086451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:12.096498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:12.097644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:12.098337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:12.101560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:12.103791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:12.105684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:12.499162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:12.499959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:12.519343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:12.519892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:12.524202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:12.525454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:12.525837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:12.526297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:12.547085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:12.563932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9bbcc7d1-4cd7-4701-a7c4-adb64b96fadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.483196 Oct 24 13:43:12.564900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 136/257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:12 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:13.374702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:13.398773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e8716094-3795-4b42-8fbf-813ffe7da591 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1502 microversion: 2.1 time: 0.900664 Oct 24 13:43:13.400327 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 122/258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:12 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1502 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:13.588631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:13.589250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:13.600492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:13.601128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:13.601566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:13.602293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:13.602742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:13.603159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:14.133212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:14.141455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8af9c09b-f1fa-46a1-8cb4-1b0d9c55f045 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.556702 Oct 24 13:43:14.159126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 137/259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:13 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:15.149916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbbdf944-9d01-460f-aa20-039b570dc88c"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:15.152917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:15.156234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=96 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:15.161965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:15.162526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:15.168014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:15.168619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:15.171787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:15.174953 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:15.175431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:15.175856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:15.177377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:15.177844 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:15.180032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:15.183459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:15.184075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:15.184496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:15.416698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:15.431127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c8939def-d7bf-4b2e-b16b-d8b9526927b4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.266729 Oct 24 13:43:15.432318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 138/260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:15 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:15.549271 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-33daf91a-3c5c-4511-b21c-1c65c780834b tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "POST /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403558 Oct 24 13:43:15.550632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 123/261] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:43:15 2022] POST /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:16.455966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:16.456700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:16.463748 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:16.464336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:16.465589 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:16.466410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:16.466895 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:16.467958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:16.649412 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:16.666912 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-04b87796-35e9-4686-b6b8-363cc607f554 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.215381 Oct 24 13:43:16.674219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 139/262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:16 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:17.692440 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:17.693134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:17.699234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:17.699800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:17.700122 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:17.700809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:17.701434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:17.701805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:17.873335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:17.883329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-07a9bc3f-9a37-4654-9c60-9a46b77b8a24 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.196248 Oct 24 13:43:17.883903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 124/263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:17 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:18.909140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:18.910341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:18.919170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=85 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:18.923873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:18.924572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:18.925011 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:18.925708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:18.926385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:18.926816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:19.078685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:19.088338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4ad5b9d1-e54d-4b1f-b1bb-0b8b39d2a4de tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.185617 Oct 24 13:43:19.090209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 140/264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:18 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:20.112781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:20.113456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:20.119846 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:20.120324 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:20.120759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:20.121450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:20.121903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:20.122364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:20.335098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:20.343219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bf374ba4-69b4-43c1-972d-38ae8f331608 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.234911 Oct 24 13:43:20.343996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 125/265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:20 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:21.368387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:21.369003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:21.375284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:21.377350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:21.377796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:21.378777 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:21.379233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:21.379653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:21.513536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:21.521661 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5cf40083-ea7c-4f6b-9f2e-f642a2ad527e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.157212 Oct 24 13:43:21.522328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 141/266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:21 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:22.544686 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:22.545296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:22.552529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:22.553006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:22.553436 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:22.554123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:22.554595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:22.555022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:22.713960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:22.722558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b3a0787a-349f-432e-b1bb-6142c05b3c48 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.181665 Oct 24 13:43:22.723123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 126/267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:22 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:23.744905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:23.745623 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:23.751439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:23.751922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:23.752343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:23.753016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:23.753460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:23.753876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:23.888064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:23.896999 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ed71a833-88fa-436e-920e-76cee06bb9b9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.155864 Oct 24 13:43:23.897563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 142/268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:23 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:24.921808 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:24.922527 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:24.931874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:24.931874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:24.931874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:24.932145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:24.932504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:24.932954 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:25.092773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:25.103100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4474e2d3-745a-4058-9626-ce453b26630f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.185254 Oct 24 13:43:25.103813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 127/269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:24 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:25.241545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-449908649", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "networks": [{"uuid": "09a31875-0bfa-48d6-a9ef-86232d03c868"}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:25.300819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] validate_networks() for [('09a31875-0bfa-48d6-a9ef-86232d03c868', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:43:25.666386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:43:25.666804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:43:25.667269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:43:25.667667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:43:25.668072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:43:25.677240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:25.677662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:25.678091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:25.678833 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:25.679284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:25.679726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:25.696531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Getting quotas for project b8ee40c2e5304b67b8814d34f3fe97b3. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:43:25.701186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Getting quotas for user 687126fda40f481cb5ba5d185cbfa74a and project b8ee40c2e5304b67b8814d34f3fe97b3. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:43:25.713509 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:43:25.715815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:43:25.762093 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f7256ad3-af7f-4642-a766-699de0deb4f6 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524266 Oct 24 13:43:25.762965 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 143/270] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:43:25.775706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8350dc03-45d8-4669-aa01-1cba2bf7f981 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:25.776321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8350dc03-45d8-4669-aa01-1cba2bf7f981 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:25.833051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8350dc03-45d8-4669-aa01-1cba2bf7f981 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:25.840615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8350dc03-45d8-4669-aa01-1cba2bf7f981 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1218 microversion: 2.1 time: 0.069876 Oct 24 13:43:25.841561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 128/271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:25 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:26.127914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:26.128524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:26.142360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:26.142360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:26.142360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:26.142360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:26.142989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:26.142989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:26.284142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:26.294914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bc88580e-ed36-47d2-b004-f7b05fd79054 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.170834 Oct 24 13:43:26.310706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 144/272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:26 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:26.864434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:26.865053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:26.871325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:26.871812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:26.872250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:26.872942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:26.873393 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:26.873819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:26.942126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:26.949732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-30c793e1-44c8-4159-9ed3-a87641f1b23e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1222 microversion: 2.1 time: 0.089859 Oct 24 13:43:26.950401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 129/273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:26 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:27.320067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:27.320677 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:27.326551 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.327026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.327451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.328129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.328572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.329013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.461438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:27.462207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:27.468432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.469050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.470117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.470913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.471780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.472011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.474857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:27.484056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-29fababa-f7a2-4c2c-9842-78b0b1cf88ea tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.167923 Oct 24 13:43:27.499030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 145/274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:27 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:27.506229 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:43:27.592218 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4ce29bd7-652f-41ee-90bf-a630acb83581 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 204 len: 0 microversion: 2.1 time: 0.134328 Oct 24 13:43:27.592973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 130/275] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:27 2022] DELETE /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:43:27.601742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:27.602588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:27.608530 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.609087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.609595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.611112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.611778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.612277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.749421 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:27.758289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d902e61f-ac83-44c1-8c88-978103bebbea tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1554 microversion: 2.1 time: 0.160456 Oct 24 13:43:27.758833 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 146/276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:27 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:27.973126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:27.973825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:27.980249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.980728 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.981239 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:27.981869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:27.982346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:27.982769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.043942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:28.052114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3904dd7f-a110-437a-be43-20d67faad67c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1222 microversion: 2.1 time: 0.083350 Oct 24 13:43:28.052674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 131/277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:27 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:28.511133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:28.511505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:28.518051 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:28.518558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:28.518983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.519668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:28.520110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:28.520538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.524503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:28.651165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:28.659053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f3527ecc-b8a4-4f6d-ad97-b8fc0d81daf8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.152229 Oct 24 13:43:28.659621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 147/278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:28 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:28.782923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:28.783752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:28.789732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:28.790265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:28.790698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.791382 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:28.791826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:28.792251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:28.921503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:28.930292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-88e6a25f-94ac-423e-9b91-e913ae2cf58a tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1554 microversion: 2.1 time: 0.151719 Oct 24 13:43:28.930861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 132/279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:28 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:29.074992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:29.075595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:29.081436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:29.081901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:29.082366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:29.083043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:29.083489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:29.083899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:29.142516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:29.149840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-eac69245-7803-4a87-a33a-bc1b05cf603e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1214 microversion: 2.1 time: 0.078636 Oct 24 13:43:29.150415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 148/280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:29 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:29.682456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:29.683064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:29.689862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:29.690377 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:29.690809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:29.691495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:29.691946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:29.692372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:29.825482 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:29.834461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78f4da36-424a-4b91-84ea-83787d544928 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.156030 Oct 24 13:43:29.835028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 133/281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:29 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:29.953112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:29.953790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:29.959880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:29.960404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:29.960910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:29.961750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:29.962229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:29.962675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:30.089072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:30.097868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ed0ca78e-8e60-475d-9a51-281d229ae0a5 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1554 microversion: 2.1 time: 0.148548 Oct 24 13:43:30.098440 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 149/282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:29 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:30.172585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:30.173903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:30.179855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:30.180339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:30.180774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:30.181461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:30.181914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:30.182365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:30.186422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:30.255094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:30.263168 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2771f9de-1bdc-4c31-8d9f-59d22797ba1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1214 microversion: 2.1 time: 0.094349 Oct 24 13:43:30.263918 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 134/283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:30 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:30.857607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:30.858213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:30.864965 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:30.865445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:30.865877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:30.866583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:30.867033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:30.867483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:31.003292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:31.010893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-52fc77c4-9bc7-46cf-b748-1bd627052fd6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.157272 Oct 24 13:43:31.011436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 150/284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:30 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:31.120736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:31.121286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:31.128484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:31.128961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:31.129388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:31.130070 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:31.130567 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:31.131356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:31.263012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:31.271342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0e1cf319-9039-410a-a8a9-d258e1c931aa tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1554 microversion: 2.1 time: 0.154535 Oct 24 13:43:31.271913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 135/285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:31 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:31.287503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:31.288144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:31.294001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:31.294505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:31.294930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:31.295603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:31.296043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:31.296454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:31.359559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:31.367781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8c754894-c40a-4951-a0a0-adbb267d3bb4 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1214 microversion: 2.1 time: 0.085128 Oct 24 13:43:31.368350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 151/286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:31 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:32.034454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:32.035401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:32.042552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:32.043487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:32.044226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:32.045251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:32.045966 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:32.046418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:32.193302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:32.201154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-755f628d-d128-44e4-bb78-f44c7dc940cd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.171652 Oct 24 13:43:32.201913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 136/287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:32 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:32.295341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:32.296068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:32.303240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:32.303825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:32.304331 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:32.305057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:32.305647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:32.306097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:32.391842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:32.392593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:32.398785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:32.399265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:32.399696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:32.400388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:32.400835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:32.401252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:32.436110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:32.445022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8482451c-1070-482a-a305-8c8d520bab26 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1554 microversion: 2.1 time: 0.153811 Oct 24 13:43:32.458368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 152/288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:32 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:32.463794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:32.471774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8db3c315-c497-4971-ab65-7cdcea57822a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1270 microversion: 2.1 time: 0.083773 Oct 24 13:43:32.472335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 137/289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:32 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:33.225368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:33.225978 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:33.231980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:33.232665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:33.233271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:33.234120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:33.234779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:33.235351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:33.387229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:33.396991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-31a92911-63d2-49a1-8385-9e2e528465df tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.176403 Oct 24 13:43:33.397573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 153/290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:33 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:33.470261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:33.471148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:33.479297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:33.479880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:33.480362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:33.481124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:33.481640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:33.482315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:33.496055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:33.496924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:33.505009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:33.505632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:33.506054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:33.506920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:33.507367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:33.508526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:33.578115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:33.587414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5f7a29de-3c50-4f97-9578-74f34aa9df1e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1276 microversion: 2.1 time: 0.095984 Oct 24 13:43:33.588054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 154/291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:33 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:33.805477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:33.831677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78387ec1-8396-4d66-83fc-c6f640f63c28 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1554 microversion: 2.1 time: 0.366594 Oct 24 13:43:33.832277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 138/292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:33 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1554 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:34.234290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-fe1db4de-5d30-4337-9531-d870b25959bc req-66da2c90-f73c-47bc-afa6-f4d5ff126c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c516707-ed3a-4bab-b73c-7d964cd4a782", "name": "network-vif-deleted", "tag": "c1826e2d-fbef-4b42-9fa9-ce9952cb01e7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:34.249803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-fe1db4de-5d30-4337-9531-d870b25959bc req-66da2c90-f73c-47bc-afa6-f4d5ff126c54 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.250320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-fe1db4de-5d30-4337-9531-d870b25959bc req-66da2c90-f73c-47bc-afa6-f4d5ff126c54 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.250994 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-fe1db4de-5d30-4337-9531-d870b25959bc req-66da2c90-f73c-47bc-afa6-f4d5ff126c54 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.269621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-fe1db4de-5d30-4337-9531-d870b25959bc req-66da2c90-f73c-47bc-afa6-f4d5ff126c54 service nova] Creating event network-vif-deleted:c1826e2d-fbef-4b42-9fa9-ce9952cb01e7 for instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 on hv-cinder-86249 Oct 24 13:43:34.276547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-fe1db4de-5d30-4337-9531-d870b25959bc req-66da2c90-f73c-47bc-afa6-f4d5ff126c54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046106 Oct 24 13:43:34.277364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 155/293] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:34.420548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:34.421161 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:34.429786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.430442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.431163 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.431874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.432325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.432747 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.612567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:34.613402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:34.620091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.620898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.621521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.622463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.623140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.624003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.629192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:34.640287 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-da692ff7-49be-4625-8190-bde5ef5d34b0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.223571 Oct 24 13:43:34.640875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 139/294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:34 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:34.855386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:34.856161 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:34.857609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:34.864296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.865244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.865835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.866817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.867290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6bfc38b8-9f10-4722-869c-e531b89a8afe tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.259969 Oct 24 13:43:34.867818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.868673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.874749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 156/295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:34 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:34.906083 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:34.906755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:34.907283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:34.907879 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lazy-loading 'fault' on Instance uuid 6c516707-ed3a-4bab-b73c-7d964cd4a782 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:43:34.978060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfcee4879df4843867f69c5091df370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a235b26aa4c93b2354d2af757873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:34.989342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2b15f264-c0ad-4cd9-8b7e-8d47e4cee648 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 200 len: 1351 microversion: 2.1 time: 0.137944 Oct 24 13:43:35.003037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 140/296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:34 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 1351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:35.665991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:35.667533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:35.677240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:35.677882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:35.678584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:35.679572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:35.680150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:35.680611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:35.686038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:35.722307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:35.885706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:35.895625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f0fcd9bf-87e4-418a-8c69-cac564869adb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.234452 Oct 24 13:43:35.896193 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 157/297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:35 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:35.898615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:35.899299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:35.907536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:35.909730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:35.913450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:35.915063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:35.917812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:35.918613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:35.919432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.014740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:36.015234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:36.030022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.030560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.030998 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.031706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.032159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.032608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.061186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] HTTP exception thrown: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Request method failure captured: Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 HTTP/1.1 Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYmIa_lM2L8kE6uu0Uf-AAadpLD8kN8rOSvmQFG-Y7bwr_Fn46uxYmO4DvrW0Dt0tErCZ56Oct4NK5znKmvgp0HrOzFwiRa_M8dMm4KU7MEVQS3RO-YDrgOtaV9qIq4puUamS0ZO8bRlUH8az0DqWCJlsIwM7HJJLDQ2mHJnw-Arx4 Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:43:36.067337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 9cfcee4879df4843867f69c5091df370 Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.068660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '6c516707-ed3a-4bab-b73c-7d964cd4a782'} Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:36.069544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.070701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.074838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Returning 404 to user: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:36.076779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9f0ff1e4-f44d-43d6-97d1-70bfbf24859c tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 404 len: 111 microversion: 2.1 time: 0.065742 Oct 24 13:43:36.081270 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 158/298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:36 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:43:36.217001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:36.218510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:36.220880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:36.227790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.228505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.229117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.230247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.230875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.231448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.231640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-18dbd8bc-3834-44cb-96a0-9dd7ef27df07 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.336462 Oct 24 13:43:36.246891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] HTTP exception thrown: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.252649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 141/299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:35 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Request method failure captured: Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782/os-volume_attachments HTTP/1.1 Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYmIa_lM2L8kE6uu0Uf-AAadpLD8kN8rOSvmQFG-Y7bwr_Fn46uxYmO4DvrW0Dt0tErCZ56Oct4NK5znKmvgp0HrOzFwiRa_M8dMm4KU7MEVQS3RO-YDrgOtaV9qIq4puUamS0ZO8bRlUH8az0DqWCJlsIwM7HJJLDQ2mHJnw-Arx4 Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:43:36.258995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 9cfcee4879df4843867f69c5091df370 Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.260169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'server_id': '6c516707-ed3a-4bab-b73c-7d964cd4a782'} Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:36.260813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:36.263555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Returning 404 to user: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:36.263555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e4efcfaf-f1fd-49fc-b898-9d50f389cdc8 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047300 Oct 24 13:43:36.263555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 159/300] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:43:36 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:36.293370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-e88e1215-604c-4eb8-a3bd-bf6b6c8fcfb9 req-c1a263e3-bf3f-437f-bdde-8ed607daf44a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7631d374-68d1-4087-9455-cb248b32636c", "tag": "ce7df5e1-bada-4de8-8ccb-7d3ebd721721"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:36.305197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e88e1215-604c-4eb8-a3bd-bf6b6c8fcfb9 req-c1a263e3-bf3f-437f-bdde-8ed607daf44a service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.305970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e88e1215-604c-4eb8-a3bd-bf6b6c8fcfb9 req-c1a263e3-bf3f-437f-bdde-8ed607daf44a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.306880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e88e1215-604c-4eb8-a3bd-bf6b6c8fcfb9 req-c1a263e3-bf3f-437f-bdde-8ed607daf44a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.320854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-e88e1215-604c-4eb8-a3bd-bf6b6c8fcfb9 req-c1a263e3-bf3f-437f-bdde-8ed607daf44a service nova] Creating event network-changed:ce7df5e1-bada-4de8-8ccb-7d3ebd721721 for instance 7631d374-68d1-4087-9455-cb248b32636c on hv-cinder-86249 Oct 24 13:43:36.326038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-e88e1215-604c-4eb8-a3bd-bf6b6c8fcfb9 req-c1a263e3-bf3f-437f-bdde-8ed607daf44a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036277 Oct 24 13:43:36.327003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 142/301] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:36.920675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:36.921292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:36.931343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.931879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.932475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:36.933511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:36.934129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:36.934763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.070369 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:37.078201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7c0fd582-67c6-42e8-a9d7-86b56c129245 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.161386 Oct 24 13:43:37.078738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 160/302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:36 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:37.261936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:37.262686 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:37.269568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.270044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.270530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.271216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.271665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.272085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.412563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:37.420262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-de402654-2078-43dc-98ce-18a9b61edafc tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.163022 Oct 24 13:43:37.420822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 143/303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:37 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:37.521879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:37.522412 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:37.528277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.528753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.529187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.529871 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.530388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.530814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.543797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] HTTP exception thrown: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Request method failure captured: Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 HTTP/1.1 Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYmIa_lM2L8kE6uu0Uf-AAadpLD8kN8rOSvmQFG-Y7bwr_Fn46uxYmO4DvrW0Dt0tErCZ56Oct4NK5znKmvgp0HrOzFwiRa_M8dMm4KU7MEVQS3RO-YDrgOtaV9qIq4puUamS0ZO8bRlUH8az0DqWCJlsIwM7HJJLDQ2mHJnw-Arx4 Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:43:37.545310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 9cfcee4879df4843867f69c5091df370 Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.546728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '6c516707-ed3a-4bab-b73c-7d964cd4a782'} Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:37.547462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.549107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.550734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Returning 404 to user: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:37.550734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-96731722-35c5-49ee-a0fe-ef2e06a23402 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 404 len: 111 microversion: 2.1 time: 0.028660 Oct 24 13:43:37.550734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 161/304] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:43:37 2022] DELETE /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:37.555434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:37.556051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] [instance: 6c516707-ed3a-4bab-b73c-7d964cd4a782] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:37.562351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.562845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.563283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.563988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:37.565009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:37.565433 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:37.580184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] HTTP exception thrown: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Request method failure captured: Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 HTTP/1.1 Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYmIa_lM2L8kE6uu0Uf-AAadpLD8kN8rOSvmQFG-Y7bwr_Fn46uxYmO4DvrW0Dt0tErCZ56Oct4NK5znKmvgp0HrOzFwiRa_M8dMm4KU7MEVQS3RO-YDrgOtaV9qIq4puUamS0ZO8bRlUH8az0DqWCJlsIwM7HJJLDQ2mHJnw-Arx4 Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:43:37.584757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab3a235b26aa4c93b2354d2af757873e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ab3a235b26aa4c93b2354d2af757873e Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-DeleteServersTestJSON-896943750 Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 9cfcee4879df4843867f69c5091df370 Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-DeleteServersTestJSON-896943750-project Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.586191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '6c516707-ed3a-4bab-b73c-7d964cd4a782'} Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:43:37.586981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. Oct 24 13:43:37.588539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:43:37.589715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] Returning 404 to user: Instance 6c516707-ed3a-4bab-b73c-7d964cd4a782 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:43:37.589715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-88bdd5b4-c566-4437-8e87-42558fb59409 tempest-DeleteServersTestJSON-896943750 tempest-DeleteServersTestJSON-896943750-project] 10.222.0.20 "GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782" status: 404 len: 111 microversion: 2.1 time: 0.034508 Oct 24 13:43:37.589715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 144/305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:37 2022] GET /compute/v2.1/servers/6c516707-ed3a-4bab-b73c-7d964cd4a782 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:43:38.106573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:38.107878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:38.116592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.117655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.118700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.120330 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.121642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.122399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.349088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:38.356833 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-de67154f-245a-4d47-9d31-eddcf5adce09 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.258084 Oct 24 13:43:38.357388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 162/306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:38 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:38.444040 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:38.444759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:38.451683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.452167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.452598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.453296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:38.453745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:38.454187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:38.592509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:38.601212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e0b6d9dc-4152-4445-9403-4bf66a51e578 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.161065 Oct 24 13:43:38.601788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 145/307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:38 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:39.379863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:39.381070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:39.387485 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:39.388253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:39.388857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:39.389734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:39.390382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:39.390966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:39.629316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:39.629945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:39.637340 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:39.637819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:39.638284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:39.639090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:39.639594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:39.640123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:39.696993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:39.707862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3809e2f8-19f2-485e-94a7-0e0e1784a670 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.332176 Oct 24 13:43:39.710664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 163/308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:39 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:39.870697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:39.881469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8c5690d1-1402-4350-a1c3-b767eff5bb82 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.258423 Oct 24 13:43:39.888186 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 146/309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:39 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:40.733454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:40.734032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:40.741311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:40.741796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:40.742250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:40.743080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:40.744133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:40.744965 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:40.908397 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:40.909756 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:40.926891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:40.927677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:40.928296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:40.929540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:40.930220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:40.930807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:41.088275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:41.109527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a9848c6e-26ae-469c-ad3c-29d015929b91 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.380324 Oct 24 13:43:41.124980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 164/310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:40 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:41.125292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:41.134141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-147ae5e0-980a-4d37-89df-3808486e6955 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.231446 Oct 24 13:43:41.135376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 147/311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:40 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:42.139852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:42.140652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:42.148704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:42.149419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:42.149849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:42.150877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:42.151353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:42.151775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:42.157839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:42.158928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:42.165810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:42.166319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:42.166750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:42.167438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:42.167896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:42.168318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:42.315484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:42.327118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0be21a28-4b7a-4c3e-b6f7-f08adbed0932 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.197904 Oct 24 13:43:42.327802 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 165/312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:42 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:42.332853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:42.340349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c55775f7-b5d9-4dc8-9071-f3206f9f42ee tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.187007 Oct 24 13:43:42.340896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 148/313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:42 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:43.352475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:43.354007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:43.360660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:43.362313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:43.362949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:43.363803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:43.364405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:43.364973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:43.365858 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:43.366830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:43.376928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:43.378262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:43.378752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:43.379508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:43.380004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:43.380429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:43.390849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:43.515157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:43.526808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5470d2d8-e9aa-4b2b-a359-0fe878a3e46f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.178812 Oct 24 13:43:43.527567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 166/314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:43 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:43.633088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:43.640545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-68ce5db1-0e19-41e5-b31a-c23314f08db9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.280153 Oct 24 13:43:43.641103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 149/315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:43 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:44.553161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:44.554472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:44.563567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:44.564287 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:44.565042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:44.565932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:44.566410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:44.566827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:44.669012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:44.669634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:44.676491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:44.676981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:44.677409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:44.678309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:44.678938 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:44.679513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:44.761981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:44.777217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-06f780b1-47c1-4245-b7b8-da043d1117cc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.230346 Oct 24 13:43:44.778142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 167/316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:44 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:45.045862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:45.054319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f988c3e9-e853-454d-ac13-455da7ba7f81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.392697 Oct 24 13:43:45.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 150/317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:44 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:45.803106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:45.803934 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:45.809982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:45.810743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:45.811402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:45.812196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:45.812885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:45.813399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:45.977478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:45.987219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-30f277e6-1d8c-4440-9f0f-7d6c0abf5a66 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.187753 Oct 24 13:43:45.988064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 168/318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:45 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:46.076773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:46.078198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:46.084121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:46.086117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.086810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.087218 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.088100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:46.088556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:46.088969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:46.418141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:46.422027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:46.435296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d8684008-8f58-4645-bf1a-d6926ece5960 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.361274 Oct 24 13:43:46.436073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 151/319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:46 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:47.012105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:47.012712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:47.020212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.020718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.021504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.022222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.022829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.023248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.176423 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:47.187547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-23b00a49-f567-460e-a1ae-ea7ba1102ae4 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.179425 Oct 24 13:43:47.188219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 169/320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:47 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:47.459405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:47.460515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:47.476471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.476665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.476987 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.477654 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:47.478103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:47.478554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:47.634926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:47.647049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d7c21da3-7210-4eb2-959f-44329823be92 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.192240 Oct 24 13:43:47.647656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 152/321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:47 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:47.748474 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-deba5ed2-19cf-49cb-80f0-2567d91bfa1f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'create', calling method: .version_select at 0x7f8dc2dae040>, body: {"keypair": {"name": "tempest-keypair-2082965524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClYox0oGY7KLmb35m+F5CsgII18bkyxzPtqfhy8ENK4EcteDZFAPkNpHmAUwSE1xDRtSD2KYYvq6FOTVWNdS/e6rZq22rgMXVHfsQEz8anKX8RwAMPeb5JWw4y2p4l0vg=="}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:47.766003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-deba5ed2-19cf-49cb-80f0-2567d91bfa1f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for project a578ee882e60456392c88a508d1a6db3. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:43:47.771744 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-deba5ed2-19cf-49cb-80f0-2567d91bfa1f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for user 16228db2ddd147969482871b600ac797 and project a578ee882e60456392c88a508d1a6db3. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:43:47.800060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-deba5ed2-19cf-49cb-80f0-2567d91bfa1f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.186986 Oct 24 13:43:47.800936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 170/322] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 24 13:43:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 24 13:43:48.211335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:48.212186 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:48.219439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:48.220170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:48.220781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:48.221596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:48.222058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:48.222512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:48.390130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:48.402763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-236c5d9d-ae55-4c51-a205-a37aed5bfc17 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.195490 Oct 24 13:43:48.419764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 153/323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:48 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:48.670726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:48.672135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:48.681082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:48.682012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:48.682775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:48.683658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:48.684274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:48.684872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:48.987792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:48.997065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-97be68e5-9555-419b-83da-dfcd53b76ccb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.330145 Oct 24 13:43:48.998642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 171/324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:48 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:49.328416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1979270981", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b92dd60-38ed-4cb0-991e-04c8532ad07a"}], "security_groups": [{"name": "tempest-securitygroup--883902306"}], "key_name": "tempest-keypair-2082965524", "user_data": "}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:49.428629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:49.429239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:49.431171 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:49.436456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:49.436604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] validate_networks() for [('3b92dd60-38ed-4cb0-991e-04c8532ad07a', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:43:49.436939 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:49.437372 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:49.438058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:49.438535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:49.439580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:49.579741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:49.590208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0fa8a6cd-7403-441e-8412-0b735878146a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.165303 Oct 24 13:43:49.590795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 172/325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:49 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:49.842738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:43:49.843269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:43:49.843851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:43:49.844281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:43:49.844683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:43:49.854003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:49.854502 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:49.854930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:49.855640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:49.856082 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:49.856493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:49.873117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for project a578ee882e60456392c88a508d1a6db3. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:43:49.877190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for user 16228db2ddd147969482871b600ac797 and project a578ee882e60456392c88a508d1a6db3. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:43:49.887956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:43:49.890196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:43:49.945434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6c73dfab-86e4-421d-916f-8323e71e0c91 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.621164 Oct 24 13:43:49.945985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 154/326] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 24 13:43:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 13:43:49.970684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-58a83187-2a82-4660-81c5-6a21476032c5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:49.970684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-58a83187-2a82-4660-81c5-6a21476032c5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:50.014983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-58a83187-2a82-4660-81c5-6a21476032c5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:50.021347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:50.021969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:50.024852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-58a83187-2a82-4660-81c5-6a21476032c5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:50.027201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-58a83187-2a82-4660-81c5-6a21476032c5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:50.028334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-58a83187-2a82-4660-81c5-6a21476032c5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1282 microversion: 2.20 time: 0.075131 Oct 24 13:43:50.028659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:50.030237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:50.030379 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 173/327] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:49 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:43:50.030466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:50.030466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:50.030798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:50.031224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:50.199733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:50.206977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f8ad6b8c-7a2c-4b0c-b1db-bf63566a0e5e tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.189209 Oct 24 13:43:50.211800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 155/328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:50 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:50.615034 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:50.615651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:50.621415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:50.621897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:50.622441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:50.623132 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:50.623588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:50.624005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:50.762681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:50.770862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-dc23e0fd-a747-481e-92ed-4e88784f8ddf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.160261 Oct 24 13:43:50.771515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 174/329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:50 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:51.054196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:51.054849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:51.061130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:51.061638 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:51.062063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:51.062774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:51.063216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:51.063632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:51.149704 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:51.165067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:51.166669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:51.168131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d6eeb7f8-0a15-4e48-9904-463280ada5d5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1286 microversion: 2.20 time: 0.117831 Oct 24 13:43:51.169108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 156/330] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:51 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:43:51.234954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:51.236668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:51.243871 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:51.244747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:51.246056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:51.247115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:51.247731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:51.248313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:51.397026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:51.405393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6993221e-5586-43cc-8cc5-c311f8966dbf tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.176236 Oct 24 13:43:51.405951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 175/331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:51 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:51.794762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:51.795665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:51.805717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:51.806513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:51.807112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:51.808028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:51.808652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:51.809234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:51.998289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:52.007483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-579187bf-ffcd-4ee1-beff-8811d9361833 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.216469 Oct 24 13:43:52.009095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 157/332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:51 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:52.197818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:52.198366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:52.205220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:52.205705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:52.206134 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:52.206858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:52.207308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:52.207726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:52.270041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:52.279095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:52.280534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:52.281638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-94413091-3936-448c-b6c6-160466f17d3c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1334 microversion: 2.20 time: 0.087993 Oct 24 13:43:52.282384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 176/333] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:52 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:43:52.429489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:52.430128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:52.436755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:52.437241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:52.437669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:52.438584 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:52.439556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:52.440260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:52.578657 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:52.586483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b87934c4-8227-4bc5-b79e-5d430d942287 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.160836 Oct 24 13:43:52.587042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 158/334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:52 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:53.032232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:53.033856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:53.039874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.040352 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.040777 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.041457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.042067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.042511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.185420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:53.193590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-60db502a-4b15-4104-93b0-4228f5710873 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.165894 Oct 24 13:43:53.194143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 177/335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:53 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:53.264623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-af1d83d9-1ee1-491f-872f-45733e2afb9d req-e26d5b8b-8d73-4e73-8ca9-2d492fb07467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7631d374-68d1-4087-9455-cb248b32636c", "name": "network-vif-plugged", "status": "completed", "tag": "ce7df5e1-bada-4de8-8ccb-7d3ebd721721"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:53.274554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-af1d83d9-1ee1-491f-872f-45733e2afb9d req-e26d5b8b-8d73-4e73-8ca9-2d492fb07467 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.275060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-af1d83d9-1ee1-491f-872f-45733e2afb9d req-e26d5b8b-8d73-4e73-8ca9-2d492fb07467 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.275440 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-af1d83d9-1ee1-491f-872f-45733e2afb9d req-e26d5b8b-8d73-4e73-8ca9-2d492fb07467 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.289282 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-af1d83d9-1ee1-491f-872f-45733e2afb9d req-e26d5b8b-8d73-4e73-8ca9-2d492fb07467 service nova] Creating event network-vif-plugged:ce7df5e1-bada-4de8-8ccb-7d3ebd721721 for instance 7631d374-68d1-4087-9455-cb248b32636c on hv-cinder-86249 Oct 24 13:43:53.294215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-af1d83d9-1ee1-491f-872f-45733e2afb9d req-e26d5b8b-8d73-4e73-8ca9-2d492fb07467 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033909 Oct 24 13:43:53.294798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 159/336] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:53.307600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:53.308380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:53.314953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.315441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.315895 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.316582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.317023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.317442 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.383596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:53.391757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:53.393724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:53.394851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-84d5c039-c105-4b19-bef5-7d8f3d7ba9d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1334 microversion: 2.20 time: 0.091500 Oct 24 13:43:53.395394 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 178/337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:53 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:43:53.609632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:53.610378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:53.616600 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.617076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.617507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.618247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:53.618704 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:53.619124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:53.757692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:53.766347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-195e7f04-dd11-4cf2-a59f-29d03049c513 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.161397 Oct 24 13:43:53.775256 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 160/338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:53 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:54.218977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:54.219598 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:54.227952 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:54.228635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:54.229436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:54.230346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:54.230961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:54.232226 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:54.424735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:54.425698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:54.433011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:54.433708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:54.434358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:54.436922 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:54.437568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:54.438369 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:54.444218 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:54.452208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b1a5361a-1f0b-4773-8100-5f9ec7b8ae16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.237205 Oct 24 13:43:54.453815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 179/339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:54 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:54.524803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:54.534305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:54.535825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:54.536926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d2151090-2bf5-45d2-a605-5283b127898c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1340 microversion: 2.20 time: 0.119714 Oct 24 13:43:54.537473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 161/340] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:54 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1340 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:43:54.791260 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:54.791885 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:54.797743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:54.798385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:54.799506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:54.800204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:54.800650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:54.801251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:54.962360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:54.973724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7fc48deb-ae95-48ae-80f0-12b395748ff5 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.187210 Oct 24 13:43:54.979793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 180/341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:54 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:55.477135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:55.477689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:55.484041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:55.484521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:55.484946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:55.485621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:55.486409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:55.486842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:55.563355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:55.564644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:55.575300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:55.575861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:55.576385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:55.577149 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:55.577676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:55.578182 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:55.623297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:55.631805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b64cd060-0ddb-4363-b1c7-8746db3218c0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.158540 Oct 24 13:43:55.632368 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 162/342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:55 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:55.641526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:55.650288 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:55.651733 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:55.652831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-66584594-65e4-470a-8cb5-327eae77afea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1340 microversion: 2.20 time: 0.093646 Oct 24 13:43:55.653367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 181/343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:55 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:43:56.000778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:56.001996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:56.007876 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:56.008353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:56.008991 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:56.009680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:56.010125 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:56.010568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:56.192869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:56.200470 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-271afaff-5cfa-4909-a52b-053b4d2db54a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1318 microversion: 2.1 time: 0.203509 Oct 24 13:43:56.201254 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 163/344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:55 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:56.655036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:56.655600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:56.663093 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:56.663572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:56.664002 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:56.664691 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:56.665141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:56.665558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:56.678846 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:56.679461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:56.686046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:56.686569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:56.687004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:56.687876 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:56.688331 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:56.688894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:56.813429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:56.821787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-25c2a202-b15f-4b67-9d07-75ec5ffc5f76 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1521 microversion: 2.1 time: 0.170447 Oct 24 13:43:56.822073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 182/345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:56 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:43:56.934421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:56.943069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:56.944679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:56.945641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-31c28155-dee9-496d-8b0f-9589eac167ae tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.270641 Oct 24 13:43:56.946232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 164/346] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:56 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:43:57.226811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:57.227937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:57.238646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.239127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.239556 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:57.240291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.240745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.241159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:57.274225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-ddf5f679-219e-497c-bd5c-91d18432fc63 req-d81c4b7f-dfd4-4ef9-b497-2c678f821c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:43:57.284467 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ddf5f679-219e-497c-bd5c-91d18432fc63 req-d81c4b7f-dfd4-4ef9-b497-2c678f821c41 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.284939 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ddf5f679-219e-497c-bd5c-91d18432fc63 req-d81c4b7f-dfd4-4ef9-b497-2c678f821c41 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.285357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ddf5f679-219e-497c-bd5c-91d18432fc63 req-d81c4b7f-dfd4-4ef9-b497-2c678f821c41 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:57.299990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-ddf5f679-219e-497c-bd5c-91d18432fc63 req-d81c4b7f-dfd4-4ef9-b497-2c678f821c41 service nova] Creating event network-changed:07c0c60c-b6e6-4992-af52-d3d7c785897b for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f on hv-cinder-86249 Oct 24 13:43:57.305503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-ddf5f679-219e-497c-bd5c-91d18432fc63 req-d81c4b7f-dfd4-4ef9-b497-2c678f821c41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036107 Oct 24 13:43:57.306097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 165/347] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:43:57.388031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:57.396637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-716dd574-5df8-4d46-b8f0-f343c00d729a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1507 microversion: 2.1 time: 0.176589 Oct 24 13:43:57.397292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 183/348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:57 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:57.846641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:57.848345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:57.859558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.861999 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.864360 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:57.865343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.865985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.867647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:57.971695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:57.972279 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:57.978511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.978992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.979421 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:57.980149 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:57.980599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:57.981017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:58.125043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:58.133247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:58.134827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:58.135945 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b06375d1-a14c-44f9-a6a0-110b4bb15dd9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.168624 Oct 24 13:43:58.136511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 184/349] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:57 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:43:58.381054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:58.388872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4b6e31e4-9269-4f4f-bbfd-cd9f35474850 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1501 microversion: 2.1 time: 0.548174 Oct 24 13:43:58.389703 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 166/350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:57 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1501 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:58.412004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:58.412621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:58.418675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:58.419164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:58.419605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:58.420316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:58.420759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:58.421208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:58.428002 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:43:58.569977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:58.577995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-84fec97e-26e9-4087-9936-5b5f43f31ca5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1515 microversion: 2.1 time: 0.170074 Oct 24 13:43:58.578625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 185/351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:43:58 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:43:59.162534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:43:59.163126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:43:59.169459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:59.169928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:59.170398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:59.171073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:43:59.171515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:43:59.171924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:43:59.304167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:59.312262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:59.313969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:43:59.315319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-73e398e8-d7e7-4f79-b730-d023c9726779 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.157722 Oct 24 13:43:59.316383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 167/352] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:43:59 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:00.341128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:00.341720 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:00.344685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:00.348910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:00.349383 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:00.349807 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:00.350512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:00.350958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:00.351372 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:00.483308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:00.491307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:00.492730 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:00.493820 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c1985f26-0a60-4eda-ad29-679c96a46f96 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.156606 Oct 24 13:44:00.494397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 186/353] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:00 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:01.090300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:01.092460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:01.094431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:01.095352 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:01.102269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:01.102755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:01.103182 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:01.103875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:01.104319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:01.104734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:01.128079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'flavor' on Instance uuid 40ad3d9a-2678-43ea-a489-650efa93034c {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:01.180534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:01.203299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e6301613-bf05-4bda-8ea0-5b027f5054d7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/action" status: 200 len: 32 microversion: 2.1 time: 0.117018 Oct 24 13:44:01.203924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 168/354] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:44:01 2022] POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:44:01.213848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:01.214492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:01.220556 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:01.221217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:01.221645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:01.222365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:01.222817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:01.223239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:01.357409 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:01.365693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-929c676b-39b4-41eb-9eb1-9150393175e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.155752 Oct 24 13:44:01.366274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 187/355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:01 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:01.521722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:01.522452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:01.528674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:01.529148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:01.529577 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:01.530310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:01.530756 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:01.531173 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:01.667004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:01.675810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:01.677283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:01.678432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a49fe8e2-b8ba-4708-9eff-da4786e18a6f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.161643 Oct 24 13:44:01.678982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 169/356] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:01 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:02.388960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:02.389586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:02.397520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:02.398057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:02.398517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:02.399272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:02.399727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:02.400147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:02.527678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:02.535883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-25ccc177-234d-4243-8112-c2c7f7f1a959 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.150839 Oct 24 13:44:02.536443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 188/357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:02 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:02.703118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:02.703749 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:02.711069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:02.711543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:02.711972 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:02.712650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:02.713094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:02.713537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:02.842279 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:02.850301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:02.851729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:02.852808 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-29915f62-ff7b-4880-ad36-b429d0235e8e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.153577 Oct 24 13:44:02.853359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 170/358] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:02 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:03.559018 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:03.559632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:03.565650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:03.566140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:03.566595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:03.567275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:03.567727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:03.568155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:03.701324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:03.709766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2265fc12-5f3a-418a-96dd-b4b36b7bbfb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.154556 Oct 24 13:44:03.710363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 189/359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:03 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:03.879420 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:03.879935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:03.886291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:03.886767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:03.887195 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:03.887870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:03.888313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:03.888726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:04.021495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:04.029674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:04.031128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:04.032211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ac73f64b-e708-42d6-ad51-84ce182feb6c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.157026 Oct 24 13:44:04.032756 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 171/360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:03 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:04.732755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:04.733361 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:04.740456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:04.740929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:04.741355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:04.742025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:04.742515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:04.742932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:04.876971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:04.885140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0d311270-d4f5-4e36-be1a-0ec3f4943894 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.156196 Oct 24 13:44:04.885698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 190/361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:04 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:05.056741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:05.057350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:05.063857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:05.064489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:05.064928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:05.066264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:05.066607 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:05.067097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:05.235923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:05.246621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:05.248591 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:05.250226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bb8792f9-58cc-4eb3-bed7-c69a95731802 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.197349 Oct 24 13:44:05.251233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 172/362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:05 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:05.908373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:05.908973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:05.916118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:05.916866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:05.917321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:05.918188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:05.918874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:05.919304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:06.050725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:06.058656 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8c8a22d8-c4d9-4af9-87f8-50eba97f0677 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.154309 Oct 24 13:44:06.059213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 191/363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:05 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:06.275637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:06.276247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:06.283973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:06.284464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:06.284906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:06.285664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:06.286113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:06.286560 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:06.419589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:06.427708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:06.429153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:06.430277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-46b1a4a6-3877-4a3a-a9a0-4e09c3fe2da3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.158518 Oct 24 13:44:06.430836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 173/364] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:06 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:07.081402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:07.082040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:07.092239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:07.092724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:07.093155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:07.093852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:07.094341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:07.094763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:07.229872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:07.243562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1ecaf4c6-d32f-4768-bd94-30c507979956 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.165555 Oct 24 13:44:07.244577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 192/365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:07 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:07.423300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-d897a184-ea9d-4cb7-930f-f354e6a9927b req-418dfd98-074b-4744-a559-a0b8d66817cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "name": "network-vif-plugged", "status": "completed", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:07.444170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d897a184-ea9d-4cb7-930f-f354e6a9927b req-418dfd98-074b-4744-a559-a0b8d66817cf service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:07.444170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d897a184-ea9d-4cb7-930f-f354e6a9927b req-418dfd98-074b-4744-a559-a0b8d66817cf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:07.444170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d897a184-ea9d-4cb7-930f-f354e6a9927b req-418dfd98-074b-4744-a559-a0b8d66817cf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:07.460080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:07.460551 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-d897a184-ea9d-4cb7-930f-f354e6a9927b req-418dfd98-074b-4744-a559-a0b8d66817cf service nova] Creating event network-vif-plugged:07c0c60c-b6e6-4992-af52-d3d7c785897b for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f on hv-cinder-86249 Oct 24 13:44:07.461457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:07.467109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-d897a184-ea9d-4cb7-930f-f354e6a9927b req-418dfd98-074b-4744-a559-a0b8d66817cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048622 Oct 24 13:44:07.468113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 174/366] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:07.469242 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:07.469764 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:07.470407 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:07.471241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:07.472322 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:07.472772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:07.618987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:07.629396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:07.630902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:07.632030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ae60cf3b-df4e-40f3-8348-c9c387401d32 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.180051 Oct 24 13:44:07.632599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 193/367] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:07 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:44:08.266724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:08.267432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:08.274305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:08.274790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:08.275230 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:08.275943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:08.276383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:08.276809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:08.417702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:08.425631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-063608f2-9f84-4c47-982f-e9b453060ba3 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.163025 Oct 24 13:44:08.426241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 175/368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:08 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:08.665308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:08.666073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:08.672318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:08.672809 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:08.673252 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:08.673964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:08.674643 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:08.675076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:08.807965 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:08.817003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:08.818481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:08.819622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9dea7e06-861b-4c21-9952-2021b1dbbd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1407 microversion: 2.20 time: 0.158301 Oct 24 13:44:08.820191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 194/369] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:08 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:09.448998 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:09.449623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:09.456187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:09.456691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:09.457119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:09.457792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:09.458262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:09.458686 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:09.596232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:09.604740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a0b3053f-ed95-4ced-a0c1-ac933de129fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.159632 Oct 24 13:44:09.605297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 176/370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:09 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:09.845899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:09.847211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:09.853102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:09.853662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:09.854109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:09.854896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:09.855352 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:09.855783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:09.986487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:09.994849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:09.996308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:09.997502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7706b95a-f3d7-43ae-be00-105f8df1d229 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1599 microversion: 2.20 time: 0.156209 Oct 24 13:44:09.998076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 195/371] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:44:09 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:44:10.022556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:10.023056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:10.029788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:10.030426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:10.031068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:10.031798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:10.032571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:10.033404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:10.139692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-198007a5-d057-4f73-b90c-7d5919f22032 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.121463 Oct 24 13:44:10.140277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 177/372] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 24 13:44:10 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:44:10.629251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:10.629811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:10.635904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:10.636316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:10.636778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:10.637783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:10.638262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:10.639354 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:10.882406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:10.890294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a7437de6-c183-4de0-9e3d-6c0857f4934d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.266351 Oct 24 13:44:10.890948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 196/373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:10 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:11.196653 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-ba46053a-e27c-411e-a15f-9dec03d0b1df req-2849f37a-6075-4e8b-97d4-0663d5e43765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:11.206564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ba46053a-e27c-411e-a15f-9dec03d0b1df req-2849f37a-6075-4e8b-97d4-0663d5e43765 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:11.207633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ba46053a-e27c-411e-a15f-9dec03d0b1df req-2849f37a-6075-4e8b-97d4-0663d5e43765 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:11.208066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-ba46053a-e27c-411e-a15f-9dec03d0b1df req-2849f37a-6075-4e8b-97d4-0663d5e43765 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:11.219606 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-ba46053a-e27c-411e-a15f-9dec03d0b1df req-2849f37a-6075-4e8b-97d4-0663d5e43765 service nova] Creating event network-changed:07c0c60c-b6e6-4992-af52-d3d7c785897b for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f on hv-cinder-86249 Oct 24 13:44:11.224556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-ba46053a-e27c-411e-a15f-9dec03d0b1df req-2849f37a-6075-4e8b-97d4-0663d5e43765 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032806 Oct 24 13:44:11.225174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 178/374] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:11.920277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:11.923227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:11.936264 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:11.946351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:11.948686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:11.950792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:11.951682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:11.954258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:12.391038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:12.401636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-61c5e922-3024-4c23-82df-4d15d4f72fe9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.490277 Oct 24 13:44:12.402271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 197/375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:11 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:13.427911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:13.428723 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:13.435588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:13.436089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:13.436506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:13.437203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:13.437654 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:13.438077 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:13.575216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:13.583458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-88a732e1-8edc-42f1-90c7-c5ced60dd67a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.161241 Oct 24 13:44:13.584026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 179/376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:13 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:13.756461 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-810683594", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "networks": [{"uuid": "f920e55c-d909-440b-9e00-509e8884faed"}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:13.827505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] validate_networks() for [('f920e55c-d909-440b-9e00-509e8884faed', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:44:14.169187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:44:14.169607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:44:14.170077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:44:14.170519 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:44:14.170928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:44:14.181232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:14.181751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:14.182209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:14.182932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:14.183391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:14.183796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:14.200700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Getting quotas for project 0bc5e5a0d29e43589d95be16c1fb464e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:44:14.204827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Getting quotas for user 8bdfee122af8429c9b8766949b781aee and project 0bc5e5a0d29e43589d95be16c1fb464e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:44:14.216011 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:44:14.218334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:44:14.263480 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3208155c-6162-4dca-a332-f5a4c21bd0be tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513988 Oct 24 13:44:14.264048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 198/377] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:44:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:44:14.275065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8f562fbc-e82e-45eb-aede-d3b5944b683f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:14.275813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8f562fbc-e82e-45eb-aede-d3b5944b683f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:14.335729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8f562fbc-e82e-45eb-aede-d3b5944b683f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:14.342691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8f562fbc-e82e-45eb-aede-d3b5944b683f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1213 microversion: 2.1 time: 0.071548 Oct 24 13:44:14.343427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 180/378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:14 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:14.607734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:14.608353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:14.615198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:14.615686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:14.616095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:14.616792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:14.617241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:14.617699 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:14.760205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:14.769065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-86db14c8-ed75-46d4-b86a-9dd747a9741d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.165587 Oct 24 13:44:14.769628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 199/379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:14 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:15.366261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:15.366784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:15.372867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:15.373371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:15.373799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:15.374502 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:15.374944 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:15.375355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:15.436205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:15.444434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5c6ced27-ee36-46d7-a85f-f68479048c26 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1265 microversion: 2.1 time: 0.082953 Oct 24 13:44:15.444980 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 181/380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:15 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:15.792136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:15.793294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:15.799106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:15.800366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:15.800898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:15.801594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:15.802410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:15.802838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:15.947943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:15.956118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8d3cb53c-d061-4ee7-91fe-9a7a7d86b379 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.167615 Oct 24 13:44:15.956731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 200/381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:15 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:16.468680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:16.469237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:16.472333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:16.477608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:16.478092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:16.478554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:16.479250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:16.479706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:16.480126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:16.939186 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:16.947869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8aab34b7-bd4b-44b0-8a8d-fbed5048eb02 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.483158 Oct 24 13:44:16.948439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 182/382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:16 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:16.978874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:16.979485 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:16.985255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:16.985920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:16.986455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:16.987212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:16.988092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:16.988518 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:17.128337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-f3579f7e-8ae5-4be3-915c-c420d6b30e07 req-c3dfe453-32de-40e4-9b66-b6bc0ed38fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9484f6a5-3afa-4a95-a3e4-778dda43f2f2", "tag": "c7a14b22-1485-4c66-b48d-94a1a056f80d"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:17.137203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:17.138401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f3579f7e-8ae5-4be3-915c-c420d6b30e07 req-c3dfe453-32de-40e4-9b66-b6bc0ed38fae service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:17.138972 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f3579f7e-8ae5-4be3-915c-c420d6b30e07 req-c3dfe453-32de-40e4-9b66-b6bc0ed38fae service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:17.139627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f3579f7e-8ae5-4be3-915c-c420d6b30e07 req-c3dfe453-32de-40e4-9b66-b6bc0ed38fae service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:17.145538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4355e0d2-4f43-41a2-87f5-63c87f2994e1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.170393 Oct 24 13:44:17.146318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 201/383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:16 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:17.167150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-f3579f7e-8ae5-4be3-915c-c420d6b30e07 req-c3dfe453-32de-40e4-9b66-b6bc0ed38fae service nova] Creating event network-changed:c7a14b22-1485-4c66-b48d-94a1a056f80d for instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 on hv-cinder-86249 Oct 24 13:44:17.171934 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-f3579f7e-8ae5-4be3-915c-c420d6b30e07 req-c3dfe453-32de-40e4-9b66-b6bc0ed38fae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048217 Oct 24 13:44:17.172763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 183/384] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:44:17.972091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:17.972704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:17.978639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:17.979112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:17.979653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:17.980201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:17.980646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:17.981089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:17.999430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:18.112809 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:18.120512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6881c0ea-bb61-402c-ab5b-564f19be16f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.152532 Oct 24 13:44:18.121109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 202/385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:17 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:18.170703 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:18.171395 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:18.178904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:18.179389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:18.179824 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:18.180511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:18.180966 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:18.181413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:18.310116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:18.318499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2ac24281-bde6-4a6b-9f44-2736a22f55be tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.152385 Oct 24 13:44:18.319052 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 184/386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:18 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:19.143683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:19.144510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:19.150924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:19.151434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:19.151850 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:19.152555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:19.153008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:19.153427 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:19.305631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:19.314183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-429a40a7-38e1-4949-a188-2825407151c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.174673 Oct 24 13:44:19.315711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 203/387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:19 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:19.343088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:19.343631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:19.351912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:19.352622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:19.353226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:19.353926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:19.354568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:19.354990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:19.547159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:19.555946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0c40c198-ad24-4948-bcb5-74b1dabf2cba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.217790 Oct 24 13:44:19.556722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 185/388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:19 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:20.339042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:20.340393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:20.342517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:20.347848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:20.348545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:20.349012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:20.349988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:20.350501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:20.351061 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:20.584845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:20.586030 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:20.593102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:20.593755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:20.594527 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:20.595405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:20.596015 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:20.597248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:20.629797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:20.641437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-04f85da7-baba-4738-bc5e-317f107dd65c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.306977 Oct 24 13:44:20.642296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 204/389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:20 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:20.909295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:20.918697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b9b9c228-da36-448f-afb1-8991bbccff02 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.337970 Oct 24 13:44:20.919566 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 186/390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:20 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:21.664963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:21.665733 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:21.672153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:21.672766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:21.673385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:21.674089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:21.675219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:21.675648 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:21.868721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:21.876611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-68594ba2-3e40-4068-9284-aa5f37befd9f tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.215783 Oct 24 13:44:21.878465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 205/391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:21 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:21.944408 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:21.951594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:21.963065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:21.964119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:21.965077 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:21.966481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:21.967480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:21.968068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.108919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:22.119222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0f673ed1-8217-45b7-b576-6069bcacaadd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1501 microversion: 2.1 time: 0.179364 Oct 24 13:44:22.128078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 187/392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:21 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:22.142057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b2bb8aa-4cd0-4e1e-bd65-a79b430d30dc"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:22.144578 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:22.150702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.151403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.152008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.152716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.153164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.153768 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.178955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] HTTP exception thrown: Cannot 'attach_volume' instance 40ad3d9a-2678-43ea-a489-650efa93034c while it is in vm_state rescued Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Request method failure captured: Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/os-volume_attachments HTTP/1.1 Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 74 Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYl-x2neo4NXAIMLiiF9DTr-DP3y40yUhgrDrnFH2vFUnkTTlsAjKaI46l-ToNo3WyNwj6m5yP_n7vsCfbyZtCTjs_PcHsDMqneWC3_8loL2hTnm65wLu4OYcTjb5_dlJLSvwvclAwu-B74UgwOIURmD-KGH19licV12odqlimpApw Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:44:22.181114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: be793f4685f94beba74adedbc02ee50a Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {"volumeAttachment": {"volumeId": "7b2bb8aa-4cd0-4e1e-bd65-a79b430d30dc"}} Oct 24 13:44:22.182665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Cannot 'attach_volume' instance 40ad3d9a-2678-43ea-a489-650efa93034c while it is in vm_state rescued Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'server_id': '40ad3d9a-2678-43ea-a489-650efa93034c', 'body': {'volumeAttachment': {'volumeId': '7b2bb8aa-4cd0-4e1e-bd65-a79b430d30dc'}}} Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40ad3d9a-2678-43ea-a489-650efa93034c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:44:22.183522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 40ad3d9a-2678-43ea-a489-650efa93034c while it is in vm_state rescued Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:44:22.184932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:44:22.186208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:44:22.186208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:44:22.186208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 40ad3d9a-2678-43ea-a489-650efa93034c while it is in vm_state rescued Oct 24 13:44:22.186208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:44:22.186887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Returning 409 to user: Cannot 'attach_volume' instance 40ad3d9a-2678-43ea-a489-650efa93034c while it is in vm_state rescued {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:44:22.187747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b654126d-2a87-474c-866c-f3a3a60fe4dc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050007 Oct 24 13:44:22.188669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 206/393] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:44:22 2022] POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:44:22.197578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:22.198465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:22.205498 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.206465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.207175 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.208243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.208802 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.209322 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.229050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:22.291135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-14a5fdce-0bef-43c3-b6d1-16c0a16824c7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/action" status: 202 len: 0 microversion: 2.1 time: 0.097542 Oct 24 13:44:22.293643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 188/394] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:44:22 2022] POST /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:44:22.303114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:22.303988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:22.310724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.311441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.312222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.313128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.313772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.314443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.547069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:22.557331 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d65b8148-b93e-4a46-abc9-f23057c8d10c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1509 microversion: 2.1 time: 0.259287 Oct 24 13:44:22.575187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 207/395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:22 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:22.900911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:22.901627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:22.908212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.909243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.910003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:22.910948 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:22.911412 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:22.912087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:23.092435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:23.106065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-494247d8-c898-427b-b287-82b20083f7cd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.209259 Oct 24 13:44:23.106689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 189/396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:22 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:23.583900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:23.584512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:23.592052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:23.592764 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:23.593201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:23.593897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:23.594376 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:23.595019 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:23.808144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:23.816076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0b24525f-34bf-4496-93db-87105052b95d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1509 microversion: 2.1 time: 0.236638 Oct 24 13:44:23.816644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 208/397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:23 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:24.132825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:24.133358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:24.148112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:24.150735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:24.151280 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:24.152081 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:24.152546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:24.152976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:24.317243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:24.325753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f11c14ba-e82a-42eb-b6ac-bb200068055c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.200340 Oct 24 13:44:24.326344 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 190/398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:24 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:24.522062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6ed8ceb-88e6-4993-9e6b-ed0708ddfa12", "device": "/dev/sdb"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:24.535121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:24.537357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:24.538216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:24.552280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:24.552778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:24.553211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:24.553999 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:24.554639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:24.555082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:24.841346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:24.842332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:24.844931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:24.850816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:24.851614 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:24.852567 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:24.853464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:24.854099 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:24.854694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:25.038916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:25.046855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-91051336-e9bd-4c99-bea0-a4393d5128e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1509 microversion: 2.1 time: 0.209829 Oct 24 13:44:25.050302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 191/399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:24 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:25.349977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:25.352183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:25.364690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:25.364934 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:25.365429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:25.366212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:25.367622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:25.368183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:25.556671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:25.586976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fd7b6e0b-19f3-4cfd-b28f-88b4f17e9889 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.239362 Oct 24 13:44:25.588841 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 192/400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:25 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:25.984985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0106d0da-9d09-4efc-8a44-3856f1f0cb81 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "POST /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.470773 Oct 24 13:44:25.987326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 209/401] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:44:24 2022] POST /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c/os-volume_attachments => generated 194 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:26.071426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:26.072480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:26.090220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:26.090729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:26.091211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:26.099096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:26.099589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:26.100033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:26.519184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:26.544343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5b7c0ee6-66a8-467b-85c7-16ca8ec5b6fc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1509 microversion: 2.1 time: 0.476722 Oct 24 13:44:26.551184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 193/402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:26 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:26.628131 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:26.630928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:26.651635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:26.652538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:26.653158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:26.655060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:26.656080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:26.656697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:26.901901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:26.912882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9f5b67bd-4884-4b65-96ac-6e2ce1daaea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.299913 Oct 24 13:44:26.914437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 210/403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:26 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:27.572498 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:27.573770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:27.582031 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:27.582807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:27.583439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:27.584156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:27.584606 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:27.585030 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:27.751930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:27.761790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8ac0e883-f1a2-468d-ac65-9883f247fdcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1509 microversion: 2.1 time: 0.193031 Oct 24 13:44:27.762840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 194/404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:27 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:27.937027 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:27.937642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:27.945343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:27.945823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:27.946289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:27.946986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:27.947430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:27.947842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:28.160401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:28.172515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-40f42edd-ec70-4cd1-a2de-45b40b07b679 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.239165 Oct 24 13:44:28.182723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 211/405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:27 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:28.589620 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-e8322d3f-1a6d-4608-8b5d-29fa381af86b req-6fccb602-068f-4c09-90d5-084680954b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9484f6a5-3afa-4a95-a3e4-778dda43f2f2", "name": "network-vif-plugged", "status": "completed", "tag": "c7a14b22-1485-4c66-b48d-94a1a056f80d"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:28.605665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e8322d3f-1a6d-4608-8b5d-29fa381af86b req-6fccb602-068f-4c09-90d5-084680954b58 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:28.606912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e8322d3f-1a6d-4608-8b5d-29fa381af86b req-6fccb602-068f-4c09-90d5-084680954b58 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:28.607549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e8322d3f-1a6d-4608-8b5d-29fa381af86b req-6fccb602-068f-4c09-90d5-084680954b58 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:28.622949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-e8322d3f-1a6d-4608-8b5d-29fa381af86b req-6fccb602-068f-4c09-90d5-084680954b58 service nova] Creating event network-vif-plugged:c7a14b22-1485-4c66-b48d-94a1a056f80d for instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 on hv-cinder-86249 Oct 24 13:44:28.629809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-e8322d3f-1a6d-4608-8b5d-29fa381af86b req-6fccb602-068f-4c09-90d5-084680954b58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045931 Oct 24 13:44:28.631948 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 195/406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:44:28.789587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:28.790353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:28.802485 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:28.804791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:28.805414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:28.815870 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:28.816342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:28.816744 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:29.113695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:29.121889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4277e18d-8b7c-4c11-9b0b-6a2fe5f543e0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1509 microversion: 2.1 time: 0.336333 Oct 24 13:44:29.122563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 212/407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:28 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:29.197783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:29.201352 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:29.209328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:29.210121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:29.210742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:29.211755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:29.212697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:29.213293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:29.418454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:29.431043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fee7d753-0ce6-47df-9d95-16688f5dbc74 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.237328 Oct 24 13:44:29.432497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 196/408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:29 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:30.146751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:30.148930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:30.164820 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:30.165321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:30.165763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:30.166507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:30.166972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:30.167398 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:30.332075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:30.340283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b8ec153a-eb4c-4a5a-abcb-a0da9f7f959d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1515 microversion: 2.1 time: 0.198575 Oct 24 13:44:30.340874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 213/409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:30 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:30.457811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:30.459087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:30.468523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:30.486535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:30.490048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:30.491137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:30.491607 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:30.492204 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:30.694148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:30.722124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-58d39ca5-7db8-4375-9d0e-10779e50ac4c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1313 microversion: 2.1 time: 0.262722 Oct 24 13:44:30.742114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 197/410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:30 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:31.772049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:31.772725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:31.780894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:31.781392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:31.781827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:31.782570 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:31.783270 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:31.783733 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:31.912131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-952c6acc-21b9-46b3-8599-dad595e88901 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'create', calling method: .version_select at 0x7f8dc2a0d820>, body: {"keypair": {"name": "tempest-keypair-626614413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEVV0xR5/wEuJuEVpOCd5WaY2qRjMg9xeWL7JcDBW4TeYHCwYpwVReKDZXmPvpZ/LxnPGbECJmkX9Mh5CiAr1Y9Q9bMQb9Z01OMfTIHNiJCeMpdTp6FpxIePsxV7ZLvpA=="}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:31.952139 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-952c6acc-21b9-46b3-8599-dad595e88901 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for project d506ce8ca200496cbc15d09f49eab942. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:44:31.962543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-952c6acc-21b9-46b3-8599-dad595e88901 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for user be793f4685f94beba74adedbc02ee50a and project d506ce8ca200496cbc15d09f49eab942. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:44:31.975258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:31.988456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b1128185-df89-4b2b-9982-06f269bb6a5e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1495 microversion: 2.1 time: 0.223107 Oct 24 13:44:31.989048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 214/411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:31 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1495 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:32.011864 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-952c6acc-21b9-46b3-8599-dad595e88901 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105061 Oct 24 13:44:32.013782 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 198/412] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:44:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:32.568062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:32.568573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:32.585148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:32.588087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:32.589746 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:32.590776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:32.592375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:32.593383 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:32.673250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:44:32.835849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d9a4254b-54c2-4a37-8d42-4ef9e5fb0bf4 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 204 len: 0 microversion: 2.1 time: 0.270426 Oct 24 13:44:32.838081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 215/413] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:44:32 2022] DELETE /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:44:32.846097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:32.846748 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:32.859649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:32.860364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:32.860986 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:32.862732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:32.863463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:32.864051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:33.044463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:33.059770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d280498e-e9f3-4f2f-afe1-596e7416a2f0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1501 microversion: 2.1 time: 0.217470 Oct 24 13:44:33.068443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 199/414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:32 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1501 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:33.875879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1768137144", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94b6e578-e64e-47ab-b529-0c7aff6ffe99"}], "security_groups": [{"name": "tempest-securitygroup--414363973"}], "key_name": "tempest-keypair-626614413", "user_data": "}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:34.066503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] validate_networks() for [('94b6e578-e64e-47ab-b529-0c7aff6ffe99', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:44:34.112277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:34.116615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:34.134146 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:34.135250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:34.136356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:34.137265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:34.138035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:34.138748 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:34.354095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:34.368616 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5c6b2fdb-f175-4242-bd13-cb5effa7d736 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1501 microversion: 2.1 time: 0.271232 Oct 24 13:44:34.383147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 200/415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:34 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:34.562010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:44:34.563099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:44:34.563589 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:44:34.564001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:44:34.564413 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:44:34.580201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:34.581466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:34.582216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:34.583522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:34.584517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:34.585501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:34.608857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for project d506ce8ca200496cbc15d09f49eab942. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:44:34.615234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Getting quotas for user be793f4685f94beba74adedbc02ee50a and project d506ce8ca200496cbc15d09f49eab942. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:44:34.627119 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:44:34.630778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:44:34.716454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cc743999-221d-4471-9fa3-95e7a9337da8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.841783 Oct 24 13:44:34.717796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 216/416] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:44:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:44:34.729835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5ab4790-240c-4394-a55b-654c0f234ede tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:34.730471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d5ab4790-240c-4394-a55b-654c0f234ede tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:34.909526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d5ab4790-240c-4394-a55b-654c0f234ede tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:34.918825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d5ab4790-240c-4394-a55b-654c0f234ede tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1245 microversion: 2.1 time: 0.192855 Oct 24 13:44:34.921988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 201/417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:34 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1245 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:35.397736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:35.399465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:35.417543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:35.418469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:35.419381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:35.420970 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:35.422757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:35.424497 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:35.467414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:35.651120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:35.662502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1acab5b5-67f0-42a0-8160-51eb23dc4dbe tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1501 microversion: 2.1 time: 0.271321 Oct 24 13:44:35.663274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 217/418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:35 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:35.675392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-e8986522-f7e0-48c1-81f4-571881d0cf97 req-13c17cad-c467-4877-be64-ca6d8b48bcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9484f6a5-3afa-4a95-a3e4-778dda43f2f2", "name": "network-vif-deleted", "tag": "c7a14b22-1485-4c66-b48d-94a1a056f80d"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:35.686524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e8986522-f7e0-48c1-81f4-571881d0cf97 req-13c17cad-c467-4877-be64-ca6d8b48bcaf service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:35.687305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e8986522-f7e0-48c1-81f4-571881d0cf97 req-13c17cad-c467-4877-be64-ca6d8b48bcaf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:35.687931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e8986522-f7e0-48c1-81f4-571881d0cf97 req-13c17cad-c467-4877-be64-ca6d8b48bcaf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:35.705993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-e8986522-f7e0-48c1-81f4-571881d0cf97 req-13c17cad-c467-4877-be64-ca6d8b48bcaf service nova] Creating event network-vif-deleted:c7a14b22-1485-4c66-b48d-94a1a056f80d for instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 on hv-cinder-86249 Oct 24 13:44:35.712669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-e8986522-f7e0-48c1-81f4-571881d0cf97 req-13c17cad-c467-4877-be64-ca6d8b48bcaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041679 Oct 24 13:44:35.713623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 202/419] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:35.947506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:35.948458 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:35.954883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:35.956378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:35.957338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:35.958283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:35.962403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:35.964779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:36.062858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:36.073510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bb8db81b-7bc8-4ae9-8be3-9789107d2f96 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1297 microversion: 2.1 time: 0.130611 Oct 24 13:44:36.074706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 218/420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:35 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1297 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:36.688311 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:36.690425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:36.698652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:36.699479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:36.700007 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:36.700771 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:36.701290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:36.701818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:36.736119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:36.737976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:36.738677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:36.739522 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:36.801518 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:36.811503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-831b0cc7-720b-465d-abd8-f228b8de98a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1303 microversion: 2.1 time: 0.127650 Oct 24 13:44:36.827469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 203/421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:36 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:37.103003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:37.103777 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:37.117804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:37.118673 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:37.119344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:37.120108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:37.120567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:37.120990 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:37.194583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:37.207341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a2292b81-510b-4295-8130-c041a5f41b38 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1297 microversion: 2.1 time: 0.107951 Oct 24 13:44:37.208540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 219/422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:37 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:37.835930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:37.836575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:37.843189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:37.843666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:37.844290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:37.845162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:37.845804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:37.846414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:37.879847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:37.880326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:37.880761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:37.881223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:37.928509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:37.938066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-90fe2e11-5bc7-4ef0-b0d2-881f4612a435 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1303 microversion: 2.1 time: 0.105783 Oct 24 13:44:37.938585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 204/423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:37 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:38.232806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:38.233588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:38.240894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:38.241680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:38.242384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:38.243157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:38.243687 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:38.244177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:38.310850 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:38.318698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-12f61805-9861-41ec-8c73-a82bda130668 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1297 microversion: 2.1 time: 0.089624 Oct 24 13:44:38.319267 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 220/424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:38 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:38.961175 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:38.961975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:38.968135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:38.968613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:38.969229 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:38.969924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:38.970405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:38.971246 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:39.015104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:39.015496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:39.015921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:39.016382 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:39.062054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:39.072375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1eefbd70-1217-4033-952c-443697081e0c tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1303 microversion: 2.1 time: 0.115020 Oct 24 13:44:39.072956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 205/425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:38 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:39.342492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:39.343977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:39.351588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:39.352428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:39.352938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:39.353718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:39.354403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:39.354830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:39.427547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:39.436147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a9049177-8600-4bfd-b2d2-55bc615040d5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1297 microversion: 2.1 time: 0.097438 Oct 24 13:44:39.446023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 221/426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:39 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:40.096120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:40.096928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:40.103463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:40.103945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:40.104612 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:40.105519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:40.106220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:40.106870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:40.130378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:40.144439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:40.145352 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:40.145927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:40.146522 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:40.193102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:40.204424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d56f245d-9dab-4aaa-ae3f-8341a2057179 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1303 microversion: 2.1 time: 0.112182 Oct 24 13:44:40.210376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 206/427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:40 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:40.470316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:40.472656 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:40.478942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:40.479424 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:40.479853 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:40.481587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:40.481587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:40.481587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:40.553392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:40.574269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d1905326-a91f-43e0-97b9-97e360b8f7fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1297 microversion: 2.1 time: 0.116946 Oct 24 13:44:40.596042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 222/428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:40 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1297 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:41.210523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-84482b8b-84a6-4e09-9915-135409a649d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Action: 'create', calling method: .version_select at 0x7f8dc2a77e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1891665364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0XPg/Zfc7mHvikQXgcrPQoaz/ORANlbZB9+UeniiuiW4lswjj537G6HY9StCwmPA1rgOxPt7bRA7t2ZfXN/w9Dda4MdtTTL+uH06kT4yINdqjpuN48WoG/hroBgB74EQ=="}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:41.226916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-84482b8b-84a6-4e09-9915-135409a649d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Getting quotas for project 5243c296c8cb4467bfd269e4622e1adb. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:44:41.229687 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:41.230812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:41.231037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-84482b8b-84a6-4e09-9915-135409a649d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Getting quotas for user 6e926bb8de284795bb6ebbda2dccc266 and project 5243c296c8cb4467bfd269e4622e1adb. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:44:41.238259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:41.238867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:41.239307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:41.240017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:41.240671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:41.241116 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:41.259149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-84482b8b-84a6-4e09-9915-135409a649d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053552 Oct 24 13:44:41.271550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 207/429] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:44:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:41.277511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:41.278422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:41.279599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:41.280113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:41.335400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:41.348757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3c9f0c22-bbfe-423e-a3a9-6ebefe27ac77 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 200 len: 1303 microversion: 2.1 time: 0.123629 Oct 24 13:44:41.349792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 223/430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:41 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:41.384127 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-80704468", "imageRef": "908f9345-7a79-4a22-96f7-91dcd179535e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1891665364", "networks": [{"uuid": "9328c0ed-475e-4c2e-b2a4-f9f0a0efafff"}]}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:41.445471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] validate_networks() for [('9328c0ed-475e-4c2e-b2a4-f9f0a0efafff', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:44:41.601531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:41.602384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:41.608770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:41.609249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:41.609681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:41.610404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:41.610857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:41.611277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:41.680455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:41.688959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-53c621f9-b69f-4d0f-905c-2a3c7d80aaaf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1303 microversion: 2.1 time: 0.091314 Oct 24 13:44:41.689610 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 224/431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:41 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:42.235280 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:44:42.235700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:44:42.236154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:44:42.237452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:44:42.237926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:44:42.246602 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.247076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.247505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.248213 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.248660 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.249076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.266859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Getting quotas for project 5243c296c8cb4467bfd269e4622e1adb. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:44:42.271539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Getting quotas for user 6e926bb8de284795bb6ebbda2dccc266 and project 5243c296c8cb4467bfd269e4622e1adb. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:44:42.282504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:44:42.285071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='908f9345-7a79-4a22-96f7-91dcd179535e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:44:42.331305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3688131e-fd4e-4c3c-8fd2-35c86dcdfc96 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951524 Oct 24 13:44:42.331959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 208/432] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:44:42.343137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e813002f-221b-42af-a6d8-0f377eb46ffe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:42.343753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e813002f-221b-42af-a6d8-0f377eb46ffe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:42.375228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:42.375844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: 9484f6a5-3afa-4a95-a3e4-778dda43f2f2] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:42.383844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:42.390968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.391549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.392172 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.393995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.394720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.395303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.412228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e813002f-221b-42af-a6d8-0f377eb46ffe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:42.413637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] HTTP exception thrown: Instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 could not be found. Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Request method failure captured: Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 HTTP/1.1 Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpasev7Qy3uLGmB8bXkfLwpKpejxfwpydMdrqPCR6-GcJWmwD8ZDp_2OtkQKVQFiIqyY2ulV8_QVJJV9sO5kF6sCh4TXd_NdiSk2wzNySC2Fge9Sc3yCpn33dQZjLfmXucchnyEme6Z3yGy821otcH0XNIBHfwBBcVZeSHH_FrZ8VRc Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0bc5e5a0d29e43589d95be16c1fb464e Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesActionsTest-1943452540 Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:44:42.415339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesActionsTest-1943452540 Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0bc5e5a0d29e43589d95be16c1fb464e Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesActionsTest-1943452540 Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesActionsTest-1943452540-project Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 8bdfee122af8429c9b8766949b781aee Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesActionsTest-1943452540-project Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 could not be found. Oct 24 13:44:42.416904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '9484f6a5-3afa-4a95-a3e4-778dda43f2f2'} Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 could not be found. Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:44:42.417924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 could not be found. Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 could not be found. Oct 24 13:44:42.419409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:44:42.435616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e813002f-221b-42af-a6d8-0f377eb46ffe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1257 microversion: 2.1 time: 0.080185 Oct 24 13:44:42.435616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 225/433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:42 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:42.435931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Returning 404 to user: Instance 9484f6a5-3afa-4a95-a3e4-778dda43f2f2 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:44:42.435931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bbe8295e-ed01-43d9-9047-9aaec83f2566 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2" status: 404 len: 111 microversion: 2.1 time: 0.052385 Oct 24 13:44:42.435931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 209/434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:42 2022] GET /compute/v2.1/servers/9484f6a5-3afa-4a95-a3e4-778dda43f2f2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:44:42.537115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-131960765", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "networks": [{"uuid": "f920e55c-d909-440b-9e00-509e8884faed"}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:42.595075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] validate_networks() for [('f920e55c-d909-440b-9e00-509e8884faed', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:44:42.701593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-41efdfe1-2039-4116-91bb-e94852cc1ac4 req-5ce91e6e-149e-404b-b993-f78f13ed3d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9579f437-ab71-4398-b0b8-9a0a9248866d", "tag": "194721dc-2119-43f8-b40f-44906812d57a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:42.714193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-41efdfe1-2039-4116-91bb-e94852cc1ac4 req-5ce91e6e-149e-404b-b993-f78f13ed3d12 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.714916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-41efdfe1-2039-4116-91bb-e94852cc1ac4 req-5ce91e6e-149e-404b-b993-f78f13ed3d12 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.715493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-41efdfe1-2039-4116-91bb-e94852cc1ac4 req-5ce91e6e-149e-404b-b993-f78f13ed3d12 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.738012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-41efdfe1-2039-4116-91bb-e94852cc1ac4 req-5ce91e6e-149e-404b-b993-f78f13ed3d12 service nova] Creating event network-changed:194721dc-2119-43f8-b40f-44906812d57a for instance 9579f437-ab71-4398-b0b8-9a0a9248866d on hv-cinder-86249 Oct 24 13:44:42.745305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-41efdfe1-2039-4116-91bb-e94852cc1ac4 req-5ce91e6e-149e-404b-b993-f78f13ed3d12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047137 Oct 24 13:44:42.746055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 210/435] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:44:42.752404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:42.753307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:42.760201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.761423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.761867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.762608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:42.763060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:42.763483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:42.909176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:42.916863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0eba71a4-f8e4-4b38-ba20-f0e3e42a74ba tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.169348 Oct 24 13:44:42.917435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 211/436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:42 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:43.012924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:44:43.013411 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:44:43.013805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:44:43.014236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:44:43.014680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:44:43.023341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:43.023822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:43.024261 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:43.024991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:43.025448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:43.025873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:43.045413 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Getting quotas for project 0bc5e5a0d29e43589d95be16c1fb464e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:44:43.050038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Getting quotas for user 8bdfee122af8429c9b8766949b781aee and project 0bc5e5a0d29e43589d95be16c1fb464e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:44:43.060891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:44:43.063107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:44:43.108614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2e1e4bd8-4bbf-417a-ae27-16684fc35ace tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575550 Oct 24 13:44:43.109261 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 226/437] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:44:43.121207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78f1f6cf-1d0a-4149-b37f-b058b3f3bb92 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:43.121825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78f1f6cf-1d0a-4149-b37f-b058b3f3bb92 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:43.176506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-78f1f6cf-1d0a-4149-b37f-b058b3f3bb92 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:43.183663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78f1f6cf-1d0a-4149-b37f-b058b3f3bb92 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1213 microversion: 2.1 time: 0.066225 Oct 24 13:44:43.184387 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 212/438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:43 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:43.445230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:43.445910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:43.452379 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:43.452901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:43.453341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:43.454045 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:43.454513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:43.454962 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:43.526189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:43.534063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b873d3bd-cbed-4a50-b032-8ce2f067cbf5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1261 microversion: 2.1 time: 0.092771 Oct 24 13:44:43.534652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 227/439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:43 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:43.940991 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:43.941604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:43.948617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:43.949095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:43.949529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:43.950237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:43.950689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:43.951120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:44.089041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:44.096584 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c68ece37-c0b8-4764-bff4-9979e5c11ad2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.160080 Oct 24 13:44:44.097133 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 213/440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:43 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:44.208500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:44.209111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:44.216096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:44.216607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:44.217037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:44.217908 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:44.218405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:44.218842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:44.281435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:44.289397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6ed30bc4-b25f-494b-a5ff-a307cfcd7136 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1217 microversion: 2.1 time: 0.085155 Oct 24 13:44:44.289964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 228/441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:44 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:44.556854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:44.557464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:44.563552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:44.564028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:44.564496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:44.565269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:44.565721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:44.566182 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:44.625797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:44.633594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-32c26332-39e1-4409-958f-ab309934685b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1261 microversion: 2.1 time: 0.080648 Oct 24 13:44:44.634144 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 214/442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:44 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:45.119609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:45.120254 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:45.126194 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:45.126676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:45.127868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:45.128712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:45.129168 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:45.129592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:45.259228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:45.266815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8b10afc2-cede-41a0-8198-b76f4f20c4a9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.151045 Oct 24 13:44:45.267386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 229/443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:45 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:45.312754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:45.313405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:45.319806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:45.320289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:45.320793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:45.321477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:45.321931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:45.322416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:45.382481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:45.390008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d5d0c936-fe02-4c52-809c-7c6773cdbd19 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1217 microversion: 2.1 time: 0.081292 Oct 24 13:44:45.390596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 215/444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:45 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:45.656843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:45.657458 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:45.664412 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:45.664915 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:45.665350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:45.666029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:45.666506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:45.666927 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:45.727513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:45.734985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c01e6ac2-5a1b-4a4a-89bf-8aa11f13eb50 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1261 microversion: 2.1 time: 0.082058 Oct 24 13:44:45.735538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 230/445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:45 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:46.289757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:46.290426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:46.296398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:46.296879 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:46.297315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:46.298003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:46.298490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:46.298952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:46.413253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:46.413857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:46.420767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:46.421240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:46.421668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:46.422391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:46.422836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:46.423249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:46.432677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:46.441575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-02ac9b85-b917-4a97-b840-79ee6b6cb0ce tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.155590 Oct 24 13:44:46.442253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 216/446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:46 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:46.483898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:46.492192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a837baa8-20ab-436c-ab2b-5b9f5058235b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1217 microversion: 2.1 time: 0.082819 Oct 24 13:44:46.492745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 231/447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:46 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:46.758866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:46.759481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:46.765855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:46.766364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:46.766796 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:46.767562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:46.769013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:46.769444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:46.846938 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:46.855398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ed3318cf-9ac7-4f99-b1f8-cd1ff4d1a91c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1253 microversion: 2.1 time: 0.100295 Oct 24 13:44:46.856055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 217/448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:46 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1253 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:47.464285 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:47.464887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:47.473244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:47.473738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:47.474375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:47.475069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:47.475516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:47.475933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:47.516353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:47.516982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:47.523326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:47.523805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:47.524528 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:47.525603 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:47.526385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:47.526955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:47.604145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:47.611833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d203b68d-b467-4149-b7e4-688ee4395f15 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1265 microversion: 2.1 time: 0.099500 Oct 24 13:44:47.612389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 218/449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:47 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:47.616269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:47.623785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b118d523-9a0d-463b-97bb-ff4af298bf7c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.163195 Oct 24 13:44:47.624415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 232/450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:47 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:47.883130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:47.884248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:47.892227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:47.893352 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:47.895622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:47.896551 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:47.897807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:47.897949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:48.026713 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:48.047805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ff03b8e9-22c7-4f22-b9d4-0a95ad72a008 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1253 microversion: 2.1 time: 0.170844 Oct 24 13:44:48.062567 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 219/451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:47 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1253 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:48.635170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:48.635715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:48.642088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:48.642607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:48.643036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:48.643726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:48.644767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:48.644767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:48.646353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:48.647537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:48.654571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:48.655050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:48.655484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:48.656376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:48.656837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:48.657250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:48.793213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:48.801974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9ca711c0-21af-432a-b782-be13fb0edca6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.170742 Oct 24 13:44:48.809528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 233/452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:48 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:48.821421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:48.830016 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f3c1bbb7-e358-44e4-a700-57d884d7b00d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.188156 Oct 24 13:44:48.830724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 220/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:48 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:49.073351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:49.073960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:49.075856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:49.081197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:49.081810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:49.082274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:49.082961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:49.083410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:49.083831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:49.144755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:49.152243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-505f5e82-0997-474b-8708-5d5042610abe tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.082763 Oct 24 13:44:49.152798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 234/454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:49 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:49.826016 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:49.826652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:49.833854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:49.834363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:49.834794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:49.835474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:49.835917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:49.836330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:49.853591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:49.854220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:49.860455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:49.860932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:49.861364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:49.862055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:49.862533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:49.863003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:49.867033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:49.965020 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:49.972889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-46248ad7-d179-4e14-9723-869cccbdbc1e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.150474 Oct 24 13:44:49.973535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 221/455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:49 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:49.995966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:50.004138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-741792fa-1ea8-4674-830a-492915635125 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.154768 Oct 24 13:44:50.004688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 235/456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:49 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:50.176563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:50.177176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:50.183089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:50.183568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:50.184004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:50.184683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:50.185134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:50.185561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:50.249452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:50.257848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d3d91627-dc3c-49fc-bc41-6be828a3f269 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.085700 Oct 24 13:44:50.258442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 222/457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:50 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:50.995862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:50.996386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:51.002722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:51.003196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:51.003760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:51.004516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:51.004960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:51.005377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:51.026576 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:51.027218 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:51.033886 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:51.034404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:51.035542 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:51.036237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:51.036693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:51.037116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:51.137284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:51.145878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f6b3ec13-5016-466f-ad87-a428bfe836ef tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.154056 Oct 24 13:44:51.146475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 236/458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:50 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:51.167400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:51.174968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b07f5b82-1d1a-497e-9d88-665ad84758ed tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.152205 Oct 24 13:44:51.175631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 223/459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:51 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:51.281717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:51.282327 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:51.289396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:51.289872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:51.290338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:51.291021 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:51.291472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:51.291887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:51.355336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:51.363347 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-12dba928-314a-45f2-85fd-5ab4f6cbb2b2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.086078 Oct 24 13:44:51.364026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 237/460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:51 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:52.169591 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:52.170224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:52.177329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:52.177800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:52.178263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:52.178945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:52.179389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:52.179806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:52.198933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:52.199543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:52.206044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:52.206631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:52.207357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:52.208184 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:52.208647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:52.209072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:52.257575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:52.318218 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:52.326016 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d682b6fe-e613-4265-a30b-3acb1ca50992 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.160212 Oct 24 13:44:52.327018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 224/461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:52 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:52.348941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:52.356569 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d2e1043b-84cf-4156-8a9f-04a64b1ec915 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.161427 Oct 24 13:44:52.357296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 238/462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:52 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:52.386678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:52.387283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:52.393076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:52.393546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:52.393976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:52.394672 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:52.395116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:52.395529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:52.458920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:52.466392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bf6f233c-436a-4262-8017-c40b5b82893d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.083506 Oct 24 13:44:52.466940 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 225/463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:52 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:53.349350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:53.349950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:53.351816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:53.352460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=14 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:53.358665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:53.359138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:53.359567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:53.360242 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:53.360689 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:53.361110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:53.380804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:53.381370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:53.386592 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=18 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:53.389025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:53.389513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:53.389943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:53.390668 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:53.391326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:53.391747 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:53.505928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:53.513465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-34db363f-0678-48d3-9ff5-f199a230ffa2 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.168587 Oct 24 13:44:53.514030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 239/464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:53 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:53.532804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:53.533346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:53.533580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:53.536882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:44:53.539879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:53.540351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:53.540774 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:53.541460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:53.541901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:53.542032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a9060a17-b64b-4edc-9432-f6c54e8c26cf tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.165715 Oct 24 13:44:53.542341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:53.542639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 226/465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:53 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:53.602070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:53.609649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a0228ec7-628f-48e8-92e8-84532b863da0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.081866 Oct 24 13:44:53.610213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 240/466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:53 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:54.537211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:54.537819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:54.544363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:54.544842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:54.545269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:54.545951 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:54.546424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:54.546852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:54.564855 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:54.565558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:54.571887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:54.572370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:54.572806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:54.573503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:54.573957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:54.574408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:54.678813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:54.686457 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-80d2f2de-9424-4d81-8ff8-3a32795dbbaf tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.153736 Oct 24 13:44:54.687022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 227/467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:54 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:54.691692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:54.692303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:54.698023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:54.698529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:54.698962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:54.699650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:54.700101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:54.700521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:54.709423 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:54.717140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f5fabf09-c8b4-4e21-9f7d-6a025b8f64c5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.156179 Oct 24 13:44:54.717858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 241/468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:54 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:54.766348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:54.775124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-85a870da-3249-4e45-9c78-234215e4c81c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.087126 Oct 24 13:44:54.775859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 228/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:54 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:55.710479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:55.711096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:55.717491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:55.717981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:55.718460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:55.719157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:55.719611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:55.720093 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:55.741778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:55.742476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:55.749867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:55.750385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:55.750815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:55.751506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:55.751965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:55.752435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:55.854813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:55.862386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e6ba8f89-1dbe-44ee-9f23-538ae5b049cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.156438 Oct 24 13:44:55.863153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 242/470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:55 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:55.867486 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:55.868096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:55.873700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:55.874205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:55.874649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:55.875339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:55.875794 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:55.876216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:55.892732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:55.900974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-04a575f2-5d59-44d3-8943-d791b73c899d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.163754 Oct 24 13:44:55.901539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 229/471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:55 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:55.942362 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:55.949961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-da00a29b-bc47-4ddf-9af6-b61a4b45ddc1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1309 microversion: 2.1 time: 0.086020 Oct 24 13:44:55.950557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 243/472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:55 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:56.717807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-3a31341f-c0b8-4788-8a49-6e223e7795de req-bea6b15f-f92d-4d63-a9b0-881267b09cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ced310-9bdb-499a-bf34-e762219e87d3", "tag": "38b9c8fd-4cd6-4cda-83d9-e3800c5b241e"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:56.728777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3a31341f-c0b8-4788-8a49-6e223e7795de req-bea6b15f-f92d-4d63-a9b0-881267b09cca service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:56.729426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3a31341f-c0b8-4788-8a49-6e223e7795de req-bea6b15f-f92d-4d63-a9b0-881267b09cca service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:56.731423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3a31341f-c0b8-4788-8a49-6e223e7795de req-bea6b15f-f92d-4d63-a9b0-881267b09cca service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:56.762398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-3a31341f-c0b8-4788-8a49-6e223e7795de req-bea6b15f-f92d-4d63-a9b0-881267b09cca service nova] Creating event network-changed:38b9c8fd-4cd6-4cda-83d9-e3800c5b241e for instance d2ced310-9bdb-499a-bf34-e762219e87d3 on hv-cinder-86249 Oct 24 13:44:56.772202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-3a31341f-c0b8-4788-8a49-6e223e7795de req-bea6b15f-f92d-4d63-a9b0-881267b09cca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057652 Oct 24 13:44:56.773333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 230/473] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:44:56.885668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:56.886367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:56.893186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:56.893671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:56.894385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:56.895097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:56.895550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:56.895968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:56.928264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:56.930315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:56.939181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:56.939888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:56.940548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:56.942356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:56.943018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:56.943641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:57.053831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:57.064477 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bec1bc67-7768-4c7b-b024-671a7308ce98 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.182661 Oct 24 13:44:57.065548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 244/474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:56 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:57.070475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:57.071289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:57.079050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:57.079749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:57.080445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:57.082593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:57.083224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:57.083814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:57.172980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:57.190117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-12eddd7b-97ad-4809-85ea-dc5ff11650ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1315 microversion: 2.1 time: 0.123397 Oct 24 13:44:57.191963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 245/475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:57 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1315 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:57.381429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:57.391302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bac0df00-7ed4-4e24-bf7a-8911db89ebe0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.469835 Oct 24 13:44:57.393308 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 231/476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:56 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:57.814658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:57.815513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:57.822410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:57.823445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:57.823887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:57.824768 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:57.825290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:57.825797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.013180 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'services' on Instance uuid 7631d374-68d1-4087-9455-cb248b32636c {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:44:58.089423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:58.090256 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:58.106488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:58.106987 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:58.107424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.109332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:58.109810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:58.110431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.160757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-453dd4a7-8ca5-4592-bde5-e3df8e2fa9a1 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c/os-volume_attachments/b6ed8ceb-88e6-4993-9e6b-ed0708ddfa12" status: 202 len: 0 microversion: 2.1 time: 0.349631 Oct 24 13:44:58.161526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 246/477] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:44:57 2022] DELETE /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c/os-volume_attachments/b6ed8ceb-88e6-4993-9e6b-ed0708ddfa12 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:44:58.216796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:58.217677 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:58.225642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:58.226124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:58.241127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.241901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:58.242415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:58.242842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.305584 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:58.314614 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6e85a20f-df94-479c-845b-278cdc8f73e6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.230167 Oct 24 13:44:58.315192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 232/478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:58 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:44:58.394531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:58.402068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7ef0d3cf-ad93-4a95-a02f-f7f63a43dae8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.189433 Oct 24 13:44:58.402649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 247/479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:58 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:58.420033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:58.420647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:58.426994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:58.427475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:58.427907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.428594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:58.429048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:58.429471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:58.567884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:58.575631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-19d9a90b-0b7c-402d-abf5-a531307efb7f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.159315 Oct 24 13:44:58.579829 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 233/480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:58 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:59.338470 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:59.339755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:59.347005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.348248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.348982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.350062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.350872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.351573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.367687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-e68ee360-d7e7-4610-867b-0e33139179ce req-f4b3a76d-c57e-47f3-b85a-f23adb961279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9579f437-ab71-4398-b0b8-9a0a9248866d", "name": "network-vif-plugged", "status": "completed", "tag": "194721dc-2119-43f8-b40f-44906812d57a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:44:59.383053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e68ee360-d7e7-4610-867b-0e33139179ce req-f4b3a76d-c57e-47f3-b85a-f23adb961279 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.383808 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e68ee360-d7e7-4610-867b-0e33139179ce req-f4b3a76d-c57e-47f3-b85a-f23adb961279 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.384967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e68ee360-d7e7-4610-867b-0e33139179ce req-f4b3a76d-c57e-47f3-b85a-f23adb961279 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.399243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-e68ee360-d7e7-4610-867b-0e33139179ce req-f4b3a76d-c57e-47f3-b85a-f23adb961279 service nova] Creating event network-vif-plugged:194721dc-2119-43f8-b40f-44906812d57a for instance 9579f437-ab71-4398-b0b8-9a0a9248866d on hv-cinder-86249 Oct 24 13:44:59.405437 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-e68ee360-d7e7-4610-867b-0e33139179ce req-f4b3a76d-c57e-47f3-b85a-f23adb961279 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041667 Oct 24 13:44:59.406132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 234/481] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:44:59.427227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:59.428244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:59.435117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.435889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.436518 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.437414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.438060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.438508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.548476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:59.556282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9a392a63-8441-4939-89a0-f50a9daef3f1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.221923 Oct 24 13:44:59.556856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 248/482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:59 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:59.588965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:59.596583 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-12a6e2c1-39b9-4d0b-b323-69b9f3ff46bd tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.175078 Oct 24 13:44:59.597167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 235/483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:59 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:44:59.601971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:44:59.602606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:44:59.608486 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.608968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.609405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.610097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:44:59.610586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:44:59.610999 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:44:59.749499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:44:59.757310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0e5dafef-81a8-4db1-a278-a55b6f290931 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.159063 Oct 24 13:44:59.757877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 249/484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:44:59 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:00.578853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:00.579471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:00.586127 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:00.586639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:00.587075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:00.587762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:00.588214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:00.588800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:00.631179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:00.633914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:00.646106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:00.646796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:00.649935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:00.651571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:00.652130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:00.652643 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:00.757418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:00.766625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-69328299-d305-45c7-917f-d863da6c4c6d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.191025 Oct 24 13:45:00.767294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 236/485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:00 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:00.786510 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:00.787129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:00.796049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:00.796540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:00.796975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:00.797679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:00.798130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:00.798591 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:00.813700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:00.823803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-51a99e00-c655-4ab9-b318-6d4485a211e5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.201957 Oct 24 13:45:00.824658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 250/486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:00 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:00.943721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:00.951508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6f2e1536-acf8-4d10-ba03-e07f6ea88e46 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.172020 Oct 24 13:45:00.952265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 237/487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:00 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:01.790630 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:01.791243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:01.798943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:01.799431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:01.799954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:01.800662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:01.801251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:01.801758 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:01.808348 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:01.849620 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:01.853629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:01.861115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:01.861598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:01.862027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:01.862777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:01.863226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:01.863651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:01.941845 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:01.950760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0f84dacd-f250-4e52-8ef7-b6f948e7454b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.164362 Oct 24 13:45:01.951418 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 251/488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:01 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:01.976552 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:01.977281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:01.983822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:01.984311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:01.984912 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:01.985623 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:01.986132 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:01.986587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:01.999977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:02.008801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-362efa2a-08eb-40d7-9c9a-2563987e4c35 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.164995 Oct 24 13:45:02.009562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 238/489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:01 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:02.137418 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:02.146391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-23331745-b1cf-4f66-a3cd-b393a7e44385 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.175200 Oct 24 13:45:02.147309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 252/490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:01 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:02.974477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:02.975089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:02.982095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:02.982613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:02.983049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:02.983738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:02.984194 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:02.984649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:03.032989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:03.033603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:03.040113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:03.040613 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:03.041215 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:03.041961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:03.042448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:03.042920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:03.138473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:03.146187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-22f9a648-d1b8-4910-8ecf-da7c0627efdb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.175528 Oct 24 13:45:03.146768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 239/491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:02 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:03.170718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:03.171369 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:03.178568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:03.179143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:03.179574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:03.180269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:03.180719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:03.181138 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:03.187212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:03.196411 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cc40e2c5-79ce-47bc-98c8-0757c332c268 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.167585 Oct 24 13:45:03.205690 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 253/492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:03 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:03.337761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:03.345335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3acab148-fa26-4872-8f0e-dc61362eb699 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.178423 Oct 24 13:45:03.345893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 240/493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:03 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:04.170729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:04.171585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:04.178296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:04.178781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:04.179216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:04.179921 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:04.180375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:04.180810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:04.220688 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:04.221295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:04.228176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:04.228664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:04.229096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:04.229800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:04.230294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:04.230720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:04.330925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:04.339029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c420bbd0-5ba9-4306-a601-23c0cf2ae60e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.172359 Oct 24 13:45:04.339801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 254/494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:04 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:04.370679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:04.371537 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:04.377284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:04.377841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:04.378478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:04.379872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:04.381042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:04.381532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:04.387570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:04.395234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fa627520-714d-4bc9-bab9-e5c76a64f0e4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.178324 Oct 24 13:45:04.395907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 241/495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:04 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:04.749986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:04.757351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5fc7636b-5256-4beb-ba05-fc335cff52fd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.391036 Oct 24 13:45:04.757907 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 255/496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:04 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:05.362491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:05.363140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:05.370072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:05.370601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:05.371072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:05.371765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:05.372222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:05.372647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:05.419237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:05.419858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:05.426961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:05.428013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:05.428508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:05.429258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:05.429769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:05.430227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:05.523636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:05.534962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-142bd834-c589-48ad-b575-7d71974c71cb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.175915 Oct 24 13:45:05.537205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 242/497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:05 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:05.629183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:05.637350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5e25d1ea-df36-4faf-9ae0-55ab8c28cdc5 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.222058 Oct 24 13:45:05.638009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 256/498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:05 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:05.780231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:05.780745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:05.787830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:05.788409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:05.788857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:05.789563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:05.790030 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:05.790485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:05.929165 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:05.936710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b98491a0-7577-4f9c-99ad-b32b7b027a0f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.160451 Oct 24 13:45:05.937274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 243/499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:05 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:06.561347 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:06.563414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:06.573019 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:06.573504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:06.573943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:06.574671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:06.575128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:06.575553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:06.662595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:06.663449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:06.670203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:06.670408 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:06.674197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:06.674197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:06.674197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:06.674197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:06.742611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:06.753283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9dd84249-85ab-44f8-a4a4-2692bf841397 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.197305 Oct 24 13:45:06.754120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 257/500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:06 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:06.832401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:06.836390 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:06.841942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a50763e6-12ce-4d57-a4d7-e1eba070ba5b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.184061 Oct 24 13:45:06.858356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 244/501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:06 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:06.959537 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:06.960153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:06.966025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:06.966540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:06.966997 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:06.967681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:06.968140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:06.968567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:07.107096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:07.115960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-47f84d16-10d1-4812-ada8-fa3a54ebe817 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.159787 Oct 24 13:45:07.116681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 258/502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:06 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:07.777244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:07.777845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:07.785361 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:07.785846 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:07.786485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:07.787337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:07.787793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:07.788217 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:07.865500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:07.866123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:07.873781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:07.874294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:07.874742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:07.875451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:07.875912 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:07.876335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:07.949946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:07.959301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-699ddac2-7507-474f-9fed-cc8f7e4a4d84 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.185171 Oct 24 13:45:07.960145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 245/503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:07 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:08.018073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:08.029338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-751ce5df-dfd9-4dc0-ace5-a41e1cb3fb0a tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.167771 Oct 24 13:45:08.030010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 259/504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:07 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:08.138775 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:08.139658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:08.145526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:08.146064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:08.147233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:08.147921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:08.148374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:08.148790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:08.313241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:08.322273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-94af6802-11aa-4d68-8f6f-216befaa0777 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.187336 Oct 24 13:45:08.322844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 246/505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:08 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:08.983588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:08.985366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:08.993464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:08.994370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:08.995098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:08.996245 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:08.996928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:08.997579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:09.053340 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:09.053962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:09.068184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:09.069965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:09.070440 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:09.071157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:09.071610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:09.072028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:09.128480 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:09.136612 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f1b931c1-334f-4046-8daa-083cb37f0804 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.157712 Oct 24 13:45:09.137191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 260/506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:08 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:09.219593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:09.227836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5da13ddf-a109-4f75-8ae7-cebd1c05932b tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.178925 Oct 24 13:45:09.228410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 247/507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:09 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:09.346203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:09.346751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:09.352935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:09.353416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:09.353859 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:09.354593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:09.355053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:09.355482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:09.488180 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:09.496878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f4410890-b06d-4323-ae23-25bc66852e39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.154624 Oct 24 13:45:09.497440 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 261/508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:09 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:10.160643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:10.161248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:10.168472 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:10.168946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:10.169376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:10.170061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:10.170549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:10.170971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:10.251413 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:10.252039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:10.258749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:10.259268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:10.259718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:10.260419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:10.260875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:10.261304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:10.310931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:10.319439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-df0add66-a1f9-4e58-8e8c-fc6076334028 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.162822 Oct 24 13:45:10.320002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 248/509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:10 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:10.394682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:10.403475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-54b8ce2d-7c1a-490b-bddc-c9766d7f9060 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.155809 Oct 24 13:45:10.404229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 262/510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:10 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:10.520350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:10.520897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:10.526923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:10.527409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:10.527849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:10.528535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:10.528993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:10.529422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:10.657273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:10.665781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6173b668-1f57-443f-9dec-892a3a915453 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.149287 Oct 24 13:45:10.666374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 249/511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:10 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:11.342579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:11.343204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:11.350628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:11.351103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:11.351534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:11.352212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:11.352656 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:11.353068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:11.427265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:11.428081 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:11.434610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:11.435093 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:11.435527 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:11.436218 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:11.436666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:11.437085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:11.482416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:11.490772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-04e4dda7-7396-4afd-b804-3ebaa8231f0e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.151491 Oct 24 13:45:11.491349 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 263/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:11 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:11.565875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:11.573714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f821b788-012d-4d10-a035-6a03cda29ba4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.150319 Oct 24 13:45:11.574295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 250/513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:11 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:11.689439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:11.690052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:11.695983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:11.696473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:11.696907 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:11.697612 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:11.698062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:11.698508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:11.830640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:11.838715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-376e2095-6501-4d9b-a445-14f28e698d8b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.153125 Oct 24 13:45:11.839280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 264/514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:11 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:12.514069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:12.514750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:12.516989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=86 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:12.522831 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:12.523304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:12.523731 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:12.524438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:12.524880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:12.525290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:12.596530 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:12.597148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:12.603935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:12.604419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:12.604855 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:12.605812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:12.606000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:12.606445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:12.658242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:12.666258 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-95abd357-78df-4cc9-a551-9e0e8ade5159 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.156020 Oct 24 13:45:12.666827 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 251/515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:12 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:12.735673 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:12.743755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0823acaa-f8df-4f99-81f3-d984e92c4d93 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.151168 Oct 24 13:45:12.744312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 265/516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:12 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:12.861750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:12.862390 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:12.869007 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:12.869475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:12.869899 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:12.871216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:12.871216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:12.871481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:12.999231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:13.007519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e2ee0f4f-61d5-4148-9f99-2d257113e224 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.149504 Oct 24 13:45:13.008075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 252/517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:12 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:13.689337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:13.689957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:13.696448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:13.696929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:13.697366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:13.698055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:13.698536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:13.698962 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:13.767268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:13.768016 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:13.774760 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:13.775316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:13.775819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:13.776651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:13.777170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:13.777602 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:13.831763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:13.839578 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d07aa5d3-b24f-4eb7-95d5-27d2c1ce221b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.153994 Oct 24 13:45:13.840160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 266/518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:13 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:13.913221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:13.920893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-075fe6c9-6f09-4489-b14a-408d047855bc tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.157444 Oct 24 13:45:13.921456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 253/519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:13 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:14.030999 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:14.031909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:14.039369 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:14.040309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:14.040991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:14.041982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:14.042716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:14.043342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:14.189717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:14.194512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:14.211068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0077e8a7-28f0-4244-b5db-ab96b1012ccb tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.183729 Oct 24 13:45:14.214252 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 267/520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:14 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:14.864379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:14.865109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:14.872500 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:14.872988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:14.873969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:14.874799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:14.875257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:14.875996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:14.944911 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:14.945523 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:14.952656 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:14.953235 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:14.953767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:14.954509 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:14.954964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:14.955384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.089476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:15.097350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c3773ac9-42c6-4b1f-9ece-8666bd86cd29 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.156496 Oct 24 13:45:15.097936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 268/521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:14 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:15.103590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-60aeec7a-efe9-4b64-bf63-39f5915b42f7 req-42c526c4-8ee4-469d-aa0a-8c4e0c5c79dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:15.113354 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-60aeec7a-efe9-4b64-bf63-39f5915b42f7 req-42c526c4-8ee4-469d-aa0a-8c4e0c5c79dd service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.113834 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-60aeec7a-efe9-4b64-bf63-39f5915b42f7 req-42c526c4-8ee4-469d-aa0a-8c4e0c5c79dd service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.114298 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-60aeec7a-efe9-4b64-bf63-39f5915b42f7 req-42c526c4-8ee4-469d-aa0a-8c4e0c5c79dd service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.126306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-60aeec7a-efe9-4b64-bf63-39f5915b42f7 req-42c526c4-8ee4-469d-aa0a-8c4e0c5c79dd service nova] Creating event network-changed:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:45:15.132232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-60aeec7a-efe9-4b64-bf63-39f5915b42f7 req-42c526c4-8ee4-469d-aa0a-8c4e0c5c79dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Oct 24 13:45:15.132849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 269/522] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:15.245156 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:15.249448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:15.259477 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.260099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.260540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.261749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.262262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.262693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.349804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:15.358113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-87b4ba4a-3a57-455d-bdf9-e9be6789f635 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.499192 Oct 24 13:45:15.358721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 254/523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:14 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:15.365394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:15.366158 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:15.372693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.373435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.373945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.374729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.375282 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.375772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.402315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:45:15.403602 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:15.411415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b495f3d9-c205-4b74-ad7c-1b29d8dffb00 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.178151 Oct 24 13:45:15.412791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 270/524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:15 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:15.476673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8197fc9b-32f5-403c-b791-3d5498b57b88 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 204 len: 0 microversion: 2.1 time: 0.116751 Oct 24 13:45:15.477249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 255/525] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:45:15 2022] DELETE /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:45:15.485381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:15.485994 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:15.492507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.492987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.493432 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.494109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:15.494609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:15.495031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:15.622064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:15.630148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-60df66fa-0e87-4ea0-9d1d-64ad6d72ae39 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1559 microversion: 2.1 time: 0.148546 Oct 24 13:45:15.630860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 271/526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:15 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:16.121797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:16.122528 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:16.128428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.128910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.129346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.130028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.131008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.131429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.263463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:16.271180 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3e5ab469-bc77-4cb0-a7c9-6dc1b93189d8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.153588 Oct 24 13:45:16.272006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 256/527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:16 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:16.381594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:16.382222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:16.388554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.389025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.389452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.390133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.390606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.391024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.435495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:16.436102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:16.442400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.443480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.443920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.444834 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.445288 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.445709 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.525680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:16.533611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-251071ae-2ad6-4506-8243-262e6acd0523 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.156496 Oct 24 13:45:16.534181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 272/528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:16 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:16.577878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:16.585943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-aa7629f3-4cfd-4f4d-8190-8a852da8edf7 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.154348 Oct 24 13:45:16.586532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 257/529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:16 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:16.652933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:16.653543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:16.659858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.660339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.660773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.661467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:16.661937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:16.662397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:16.790314 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:16.798524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-490cb6e4-5acd-4c8f-9842-7f3ac405099a tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1559 microversion: 2.1 time: 0.149327 Oct 24 13:45:16.799088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 273/530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:16 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:17.294814 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:17.295455 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:17.301272 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.301744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.302726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.303399 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.303840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.304255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.431796 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:17.439250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-29addaff-05bb-4437-99f0-3940f424dae3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.148256 Oct 24 13:45:17.439801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 258/531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:17 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:17.557401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:17.558008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:17.564607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.565078 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.565502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.566192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.566642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.567062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.609561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:17.610198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:17.617302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.617782 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.618236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.618936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.619387 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.619804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.695844 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:17.703531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-77dce982-3592-4ca9-af37-ea0f3986900e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.150025 Oct 24 13:45:17.704100 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 274/532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:17 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:17.747746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:17.751282 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:17.756303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-27cd96b8-0d4a-4fae-9110-704a633ccbf9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.150841 Oct 24 13:45:17.756873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 259/533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:17 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:17.821957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:17.822521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:17.828403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.828909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.829346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.830039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:17.830535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:17.830956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:17.959904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:17.968050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3a8c30db-2d54-41ce-8704-a23188a301e0 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1559 microversion: 2.1 time: 0.150115 Oct 24 13:45:17.968615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 275/534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:17 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:18.463075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:18.463611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:18.471477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.472026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:18.472460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:18.473148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.473647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:18.474066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:18.601178 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:18.608683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cb5a30d7-062c-4354-aed9-683c2ffe1412 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.150194 Oct 24 13:45:18.609236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 260/535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:18 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:18.726565 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:18.727105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:18.733363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.733844 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:18.734341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:18.735039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.735491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:18.735913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:18.779835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:18.780452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:18.787453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.787937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:18.788370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:18.789064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.789515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:18.789936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:18.867974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:18.875657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-07bf29ec-eef7-405f-9670-d67a362ce296 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.153110 Oct 24 13:45:18.876219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 276/536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:18 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:18.925548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:18.933878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a721ee1f-458c-4cd3-8371-19bb2d34ba16 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.157829 Oct 24 13:45:18.934482 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 261/537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:18 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:18.992916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:18.993453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:18.999309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:18.999780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.000202 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.000893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.001336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.001749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.137770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:19.145439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bf2539e7-0599-4aa1-bcd9-4166fe34fd51 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1513 microversion: 2.1 time: 0.157284 Oct 24 13:45:19.146009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 277/538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:18 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:19.633265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:19.633884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:19.639838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.640319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.640752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.641445 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.641891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.642347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.773709 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:19.781640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d3a8c71d-7722-42cb-9f69-81115e588352 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.152902 Oct 24 13:45:19.782225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 262/539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:19 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:19.899038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:19.899639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:19.902032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=88 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:19.907288 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.908014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.908444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.909128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.909576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.909992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.956484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:19.957087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:19.964152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.964634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.965067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:19.965764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:19.966235 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:19.966661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:20.040924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:20.048844 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8d713317-d27b-4408-baf8-7e1b970c583e tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.154313 Oct 24 13:45:20.049727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 278/540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:19 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:20.149611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:20.161578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-46472c6d-f46d-4645-be18-a7dbe6235782 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1370 microversion: 2.1 time: 0.208666 Oct 24 13:45:20.170222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 263/541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:19 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:20.170415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:20.170415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:20.182370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:20.182859 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:20.183295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:20.183996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:20.184451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:20.184871 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:20.324603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:20.332499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a5857ed8-1932-4be2-af01-886d926a88e8 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1513 microversion: 2.1 time: 0.166682 Oct 24 13:45:20.333070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 279/542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:20 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:20.805126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:20.805773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:20.811792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:20.812273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:20.812710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:20.813393 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:20.813845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:20.814293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.072957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:21.073569 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:21.080185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.080665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.081212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.081782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.082264 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.082688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.083984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:21.093861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b1265576-60e0-40fb-ad93-9137a0df1159 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.293046 Oct 24 13:45:21.094461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 264/543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:20 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:21.185385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:21.186997 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:21.194477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.194477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.194477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.195260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.195838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.196277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.240652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:21.250212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-06bacb6b-051e-4616-90b7-ac98c8ad1349 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.182323 Oct 24 13:45:21.250792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 280/544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:21 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:21.357191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:21.357694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:21.363737 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.364465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.364922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.366292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.367600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.368029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.511731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:21.523491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-85730e8c-30a6-40c3-a2ce-0a55c9e4da74 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1513 microversion: 2.1 time: 0.170152 Oct 24 13:45:21.524283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 281/545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:21 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:21.529275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-6efcf9c5-9e1f-484e-bb10-072dbcc3d44c req-ed382993-54a5-4a9d-b5bb-c246dee7562c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ced310-9bdb-499a-bf34-e762219e87d3", "name": "network-vif-plugged", "status": "completed", "tag": "38b9c8fd-4cd6-4cda-83d9-e3800c5b241e"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:21.540380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-6efcf9c5-9e1f-484e-bb10-072dbcc3d44c req-ed382993-54a5-4a9d-b5bb-c246dee7562c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.540848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-6efcf9c5-9e1f-484e-bb10-072dbcc3d44c req-ed382993-54a5-4a9d-b5bb-c246dee7562c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.541272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-6efcf9c5-9e1f-484e-bb10-072dbcc3d44c req-ed382993-54a5-4a9d-b5bb-c246dee7562c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.552646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-6efcf9c5-9e1f-484e-bb10-072dbcc3d44c req-ed382993-54a5-4a9d-b5bb-c246dee7562c service nova] Creating event network-vif-plugged:38b9c8fd-4cd6-4cda-83d9-e3800c5b241e for instance d2ced310-9bdb-499a-bf34-e762219e87d3 on hv-cinder-86249 Oct 24 13:45:21.558253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-6efcf9c5-9e1f-484e-bb10-072dbcc3d44c req-ed382993-54a5-4a9d-b5bb-c246dee7562c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Oct 24 13:45:21.559069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 282/546] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:21.724422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:21.733852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2c29659b-d996-44a3-ad02-04c38ac795fa tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1563 microversion: 2.1 time: 0.552246 Oct 24 13:45:21.734543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 265/547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:21 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1563 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:21.759001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:21.759592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:21.765953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.766471 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.766909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.767775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:21.768240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:21.769022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:21.848905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4c91e9bd-8e99-42d7-9501-cae3f230308a tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094368 Oct 24 13:45:21.849597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 283/548] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:45:21 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:22.120061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:22.121162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:22.127644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.128361 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.128800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.129507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.129963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.130555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.274301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:22.275769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:22.282259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.283161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.283706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.284525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.285091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.285766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.545105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:22.554140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a997883a-d22d-467d-b68a-3dfade7cc2a8 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.284910 Oct 24 13:45:22.555285 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 284/549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:22 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:22.560466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-639f1c33-4594-4d6f-ba4f-4491c064aa37 req-4f04a9f7-1ed3-44eb-b51a-8283f604400a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7631d374-68d1-4087-9455-cb248b32636c", "name": "network-vif-deleted", "tag": "ce7df5e1-bada-4de8-8ccb-7d3ebd721721"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:22.572851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-639f1c33-4594-4d6f-ba4f-4491c064aa37 req-4f04a9f7-1ed3-44eb-b51a-8283f604400a service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.573330 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-639f1c33-4594-4d6f-ba4f-4491c064aa37 req-4f04a9f7-1ed3-44eb-b51a-8283f604400a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.573797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-639f1c33-4594-4d6f-ba4f-4491c064aa37 req-4f04a9f7-1ed3-44eb-b51a-8283f604400a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.585389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-639f1c33-4594-4d6f-ba4f-4491c064aa37 req-4f04a9f7-1ed3-44eb-b51a-8283f604400a service nova] Creating event network-vif-deleted:ce7df5e1-bada-4de8-8ccb-7d3ebd721721 for instance 7631d374-68d1-4087-9455-cb248b32636c on hv-cinder-86249 Oct 24 13:45:22.590620 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-639f1c33-4594-4d6f-ba4f-4491c064aa37 req-4f04a9f7-1ed3-44eb-b51a-8283f604400a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033889 Oct 24 13:45:22.592003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 285/550] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:22.597242 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:22.597945 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:22.605868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.606521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.607118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.608148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:22.608714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:22.609218 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:22.619375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:22.628289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2e5e0f10-19ec-4abb-b35b-cacdd208d4c1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.513132 Oct 24 13:45:22.629010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 266/551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:22 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:22.681609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:22.685056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:22.689996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-66f19e40-6b40-48b9-ab57-455db225de89 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1471 microversion: 2.1 time: 0.096656 Oct 24 13:45:22.690600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 286/552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:22 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1471 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:23.165678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-abb22b0d-ede4-418d-914a-5b4aaa8023cd req-8d1bcf24-ab80-401b-9067-e27c9f18acec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9579f437-ab71-4398-b0b8-9a0a9248866d", "tag": "194721dc-2119-43f8-b40f-44906812d57a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:23.184526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-abb22b0d-ede4-418d-914a-5b4aaa8023cd req-8d1bcf24-ab80-401b-9067-e27c9f18acec service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.185856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-abb22b0d-ede4-418d-914a-5b4aaa8023cd req-8d1bcf24-ab80-401b-9067-e27c9f18acec service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.187032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-abb22b0d-ede4-418d-914a-5b4aaa8023cd req-8d1bcf24-ab80-401b-9067-e27c9f18acec service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.206292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-abb22b0d-ede4-418d-914a-5b4aaa8023cd req-8d1bcf24-ab80-401b-9067-e27c9f18acec service nova] Creating event network-changed:194721dc-2119-43f8-b40f-44906812d57a for instance 9579f437-ab71-4398-b0b8-9a0a9248866d on hv-cinder-86249 Oct 24 13:45:23.213725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-abb22b0d-ede4-418d-914a-5b4aaa8023cd req-8d1bcf24-ab80-401b-9067-e27c9f18acec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066408 Oct 24 13:45:23.214356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 267/553] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:23.578940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:23.579758 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:23.587185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.587665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.588090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.588776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.589220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.589636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.653738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:23.654587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:23.661156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.661636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.662063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.662856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.663564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.663983 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.726266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:23.734150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e2ec4792-1e7e-42e5-8e84-cfb59c2e2e10 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.159102 Oct 24 13:45:23.734749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 287/554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:23 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:23.739473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:23.741443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:23.747578 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.748284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.748928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.749861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.750500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.751081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.793171 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:23.793702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:23.794473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:23.795251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'fault' on Instance uuid 7631d374-68d1-4087-9455-cb248b32636c {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:23.812622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:23.825664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b723bca5-b39d-4dce-a608-0b7b201651d3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.175972 Oct 24 13:45:23.826275 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 268/555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:23 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:23.841813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:23.849750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d18186e2-a8ef-4b09-9316-52a5fe297e36 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1308 microversion: 2.1 time: 0.113812 Oct 24 13:45:23.850403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 288/556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:23 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:24.760710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:24.761799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:24.767996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.768477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.768911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.769599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.770051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.770524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.848725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:24.849326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:24.856319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.856793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.857217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.857893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.858376 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.858794 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.905310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:24.913629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e2d5715b-3f72-447f-951c-ac5b7536922d tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.156775 Oct 24 13:45:24.914441 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 269/557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:24 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:24.927971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:24.928658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:24.934884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.935370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.935801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.936495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.936943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.937362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.970902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:24.971379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:24.971823 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:24.972260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'fault' on Instance uuid 7631d374-68d1-4087-9455-cb248b32636c {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:24.993495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:25.001071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-13c5a365-5fdb-43a5-b52a-35371b500c16 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.156202 Oct 24 13:45:25.001638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 289/558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:24 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:25.013740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:25.021378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ef0542df-07f5-47e4-ae15-7a314353f215 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1308 microversion: 2.1 time: 0.097517 Oct 24 13:45:25.022763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 270/559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:24 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:25.936801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:25.937420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:25.944022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:25.944501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:25.944936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:25.945631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:25.946083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:25.946616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:26.025275 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:26.025890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:26.032617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:26.033096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:26.033530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:26.034248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:26.034703 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:26.035129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:26.074904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:26.082496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6d016739-8e31-4138-9bee-040ad1fa5145 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1313 microversion: 2.1 time: 0.149485 Oct 24 13:45:26.083059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 290/560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:25 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:26.088497 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:26.089098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:26.094685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:26.095153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:26.095577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:26.096250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:26.096693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:26.097712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:26.129469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:26.129948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:26.130405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:26.130851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'fault' on Instance uuid 7631d374-68d1-4087-9455-cb248b32636c {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:26.172087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:26.181497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-85bd2ede-39df-4cff-a1ca-76563679bace tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.160390 Oct 24 13:45:26.182379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 271/561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:26 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:26.186115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:26.194616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ffa4422a-b12b-44d1-9c20-ddb253e8c4ca tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1308 microversion: 2.1 time: 0.109797 Oct 24 13:45:26.195290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 291/562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:26 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:27.106475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:27.107300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:27.113643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.114219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.114935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.116220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.116673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.117091 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.204696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:27.205316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:27.212750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.213581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.213680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.214387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.214842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.215266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.247507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:27.255231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c37916da-dac0-4427-8e7b-fa85d819cdeb tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1495 microversion: 2.1 time: 0.152733 Oct 24 13:45:27.255800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 272/563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:27 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:27.261264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:27.261961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:27.267796 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.268363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.268866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.269628 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.270153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.270730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.310240 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.310846 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.311390 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.311952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'fault' on Instance uuid 7631d374-68d1-4087-9455-cb248b32636c {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:27.374434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:27.391509 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7d26a2d6-6140-467f-8c14-3a32d6dc9307 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.188980 Oct 24 13:45:27.406343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 292/564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:27 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:27.414188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:27.422928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-efaacd07-127e-4539-a86d-973eb9ce0313 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1308 microversion: 2.1 time: 0.165153 Oct 24 13:45:27.423499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 273/565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:27 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:27.775523 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:27.776129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:27.782070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.782822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.783246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.783920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.784368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.784781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.810043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:45:27.883930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b8756215-cc63-4606-861a-459ad7e96ea6 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 204 len: 0 microversion: 2.1 time: 0.112827 Oct 24 13:45:27.887795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 293/566] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:45:27 2022] DELETE /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:45:27.892917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:27.893532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:27.900232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.900714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.901149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:27.901868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:27.902355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:27.902778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:28.032126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:28.040071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-134f8cf0-d1c8-4794-98d5-9d8989a47150 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1501 microversion: 2.1 time: 0.151164 Oct 24 13:45:28.040634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 274/567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:27 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:28.417531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:28.418293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:28.424544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:28.425012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:28.425434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:28.426112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:28.426587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:28.427011 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:28.448979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:28.449611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:28.455913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:28.456388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:28.456813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:28.457492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:28.457941 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:28.458381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:28.489761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:28.490269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:28.491185 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:28.491639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'fault' on Instance uuid 7631d374-68d1-4087-9455-cb248b32636c {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:28.532878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:28.540433 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-66594dbc-088d-468f-a834-cd16e8f9e35b tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 200 len: 1308 microversion: 2.1 time: 0.095357 Oct 24 13:45:28.541002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 275/568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:28 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:28.557854 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:28.565532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-25c67ec2-68fa-446a-81ab-90a92e4349d7 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.152363 Oct 24 13:45:28.566089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 294/569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:28 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:29.062619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:29.063231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:29.069451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.069923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.070386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.071066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.071508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.071922 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.075868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:29.203589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:29.212493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a8ee77a0-eef4-4f61-945c-d0670b9be1bd tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1501 microversion: 2.1 time: 0.153366 Oct 24 13:45:29.212749 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 276/570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:29 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:29.489036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-0e95f664-71b6-4470-943c-11ca04237b0c req-8a6a2b80-497e-4b5f-9e78-0ca28d951351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "name": "network-vif-plugged", "status": "completed", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:29.499126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-0e95f664-71b6-4470-943c-11ca04237b0c req-8a6a2b80-497e-4b5f-9e78-0ca28d951351 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.499598 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-0e95f664-71b6-4470-943c-11ca04237b0c req-8a6a2b80-497e-4b5f-9e78-0ca28d951351 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.500089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-0e95f664-71b6-4470-943c-11ca04237b0c req-8a6a2b80-497e-4b5f-9e78-0ca28d951351 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.511894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-0e95f664-71b6-4470-943c-11ca04237b0c req-8a6a2b80-497e-4b5f-9e78-0ca28d951351 service nova] Creating event network-vif-plugged:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:45:29.516495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-0e95f664-71b6-4470-943c-11ca04237b0c req-8a6a2b80-497e-4b5f-9e78-0ca28d951351 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031153 Oct 24 13:45:29.517079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 295/571] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:29.562838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:29.563575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 7631d374-68d1-4087-9455-cb248b32636c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:29.570596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.571086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.571524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.572225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.572728 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.573104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.589610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] HTTP exception thrown: Instance 7631d374-68d1-4087-9455-cb248b32636c could not be found. Oct 24 13:45:29.590672 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Request method failure captured: Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c HTTP/1.1 Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpZ4OGlWQqbBkkqUCrK1wLyPY03_GygTywWWywwCnf_Q6x15jtiSnMhaBdIW60NItl6i1kM174wwPsji4HVu-AVhtM2yj5ROBg32v62pTao-L-hQq96i3zYchPJhQ88GjrIymivWrygzjyJbiLrQseUCwfbdkEKdID3hS7AsKKc2zPk Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: b8ee40c2e5304b67b8814d34f3fe97b3 Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2070870729 Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:45:29.591304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesSnapshotTestJSON-2070870729 Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: b8ee40c2e5304b67b8814d34f3fe97b3 Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2070870729 Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesSnapshotTestJSON-2070870729-project Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 687126fda40f481cb5ba5d185cbfa74a Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesSnapshotTestJSON-2070870729-project Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 7631d374-68d1-4087-9455-cb248b32636c could not be found. Oct 24 13:45:29.592889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '7631d374-68d1-4087-9455-cb248b32636c'} Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7631d374-68d1-4087-9455-cb248b32636c could not be found. Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:45:29.593833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7631d374-68d1-4087-9455-cb248b32636c could not be found. Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7631d374-68d1-4087-9455-cb248b32636c could not be found. Oct 24 13:45:29.595305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:45:29.596738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Returning 404 to user: Instance 7631d374-68d1-4087-9455-cb248b32636c could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:45:29.596817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:29.596894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9cb17a87-69fe-4bb6-bfe7-3f9eafb46560 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c" status: 404 len: 111 microversion: 2.1 time: 0.033693 Oct 24 13:45:29.596894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 277/572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:29 2022] GET /compute/v2.1/servers/7631d374-68d1-4087-9455-cb248b32636c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:45:29.608067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.608622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.609235 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.609889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:29.610591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:29.611082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:29.769113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:29.778269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d4a18a44-87d8-422d-a27c-761ae70bd999 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.192320 Oct 24 13:45:29.779234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 296/573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:29 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:30.235983 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:30.236600 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:30.243323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:30.243811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:30.244256 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:30.244959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:30.245417 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:30.245843 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:30.441599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-e2ec463d-2c46-4643-9c82-f760d9361558 req-7e77e53b-2127-4d10-90bc-6b3e6ee099e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ced310-9bdb-499a-bf34-e762219e87d3", "name": "network-vif-deleted", "tag": "38b9c8fd-4cd6-4cda-83d9-e3800c5b241e"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:30.451034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:30.451644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-e2ec463d-2c46-4643-9c82-f760d9361558 req-7e77e53b-2127-4d10-90bc-6b3e6ee099e2 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:30.452115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-e2ec463d-2c46-4643-9c82-f760d9361558 req-7e77e53b-2127-4d10-90bc-6b3e6ee099e2 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:30.452540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-e2ec463d-2c46-4643-9c82-f760d9361558 req-7e77e53b-2127-4d10-90bc-6b3e6ee099e2 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:30.458861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b346131c-2d39-4a96-8781-925238413dd1 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1501 microversion: 2.1 time: 0.226740 Oct 24 13:45:30.459996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 278/574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:30 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:30.466062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-e2ec463d-2c46-4643-9c82-f760d9361558 req-7e77e53b-2127-4d10-90bc-6b3e6ee099e2 service nova] Creating event network-vif-deleted:38b9c8fd-4cd6-4cda-83d9-e3800c5b241e for instance d2ced310-9bdb-499a-bf34-e762219e87d3 on hv-cinder-86249 Oct 24 13:45:30.476451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-e2ec463d-2c46-4643-9c82-f760d9361558 req-7e77e53b-2127-4d10-90bc-6b3e6ee099e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039127 Oct 24 13:45:30.477024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 297/575] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:45:30.800585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:30.801199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:30.808158 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:30.808636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:30.809068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:30.809750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:30.810533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:30.810656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:30.943279 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:30.951152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9a2fffd6-fd5d-472c-a845-cc13abe3ee83 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.154403 Oct 24 13:45:30.951708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 279/576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:30 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:31.483742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:31.484353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:31.490595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:31.491160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:31.491593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:31.492284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:31.492734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:31.493155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:31.556357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:31.563831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6305b3db-c77e-4ef3-8a2e-3b6811f8d5c0 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1459 microversion: 2.1 time: 0.084923 Oct 24 13:45:31.564416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 298/577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:31 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1459 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:31.973942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:31.974650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:31.981107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:31.981586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:31.982022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:31.982733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:31.983191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:31.983605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:32.118280 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:32.125808 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ebd2294a-190e-4e36-8519-23a65c29c466 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.155656 Oct 24 13:45:32.126372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 280/578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:31 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:32.588040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:32.588647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:32.595216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:32.595694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:32.596120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:32.596803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:32.597249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:32.597668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:32.628657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:32.629123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:32.629548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:32.629984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid d2ced310-9bdb-499a-bf34-e762219e87d3 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:32.670450 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:32.678585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9a4b6b63-ec96-4eeb-bbd0-7acc9e73ed2b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1303 microversion: 2.1 time: 0.093742 Oct 24 13:45:32.679143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 299/579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:32 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:33.149797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:33.150425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:33.156765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.157500 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.157941 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.158658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.159111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.159549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.290852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:33.298400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ff7cf7c8-0f26-4603-9a39-d6eb02fb1910 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.153208 Oct 24 13:45:33.299601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 281/580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:33 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:33.701529 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:33.702133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:33.708590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.709574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.710021 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.710742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.711191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.711679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.742641 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:33.743107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:33.743528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:33.743955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid d2ced310-9bdb-499a-bf34-e762219e87d3 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:33.786535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:33.794514 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1e8bfb2b-fce4-4e84-8da1-9ba4dd5abb65 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1303 microversion: 2.1 time: 0.096795 Oct 24 13:45:33.795080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 300/581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:33 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:34.322026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:34.322649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:34.328866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.329338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.329773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.330470 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.330919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.331339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.457993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:34.466085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-eec532a4-b638-4464-8e6d-66cde1176f8f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.147950 Oct 24 13:45:34.466671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 282/582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:34 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:34.818047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:34.819260 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:34.825650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.826132 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.826625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.827323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.827781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.828207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.858348 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:34.858824 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:34.859261 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:34.859704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lazy-loading 'fault' on Instance uuid d2ced310-9bdb-499a-bf34-e762219e87d3 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:45:34.862446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:34.902025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bdfee122af8429c9b8766949b781aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc5e5a0d29e43589d95be16c1fb464e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:34.909952 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3d646e49-c034-4def-8203-e3a85455295b tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 200 len: 1303 microversion: 2.1 time: 0.095788 Oct 24 13:45:34.910544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 301/583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:34 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:35.489628 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:35.490276 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:35.497507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:35.497994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:35.498463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:35.499161 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:35.499618 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:35.500044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:35.641725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:35.649661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1423b65d-3360-46a1-9cf9-60e5d0dc18a8 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1357 microversion: 2.1 time: 0.164199 Oct 24 13:45:35.650237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 283/584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:35 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:35.934274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:35.935097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] [instance: d2ced310-9bdb-499a-bf34-e762219e87d3] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:35.941472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:35.942020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:35.942544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:35.943319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:35.945067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:35.945375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:35.961055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] HTTP exception thrown: Instance d2ced310-9bdb-499a-bf34-e762219e87d3 could not be found. Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Request method failure captured: Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 HTTP/1.1 Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpasev7Qy3uLGmB8bXkfLwpKpejxfwpydMdrqPCR6-GcJWmwD8ZDp_2OtkQKVQFiIqyY2ulV8_QVJJV9sO5kF6sCh4TXd_NdiSk2wzNySC2Fge9Sc3yCpn33dQZjLfmXucchnyEme6Z3yGy821otcH0XNIBHfwBBcVZeSHH_FrZ8VRc Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: 0bc5e5a0d29e43589d95be16c1fb464e Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-VolumesActionsTest-1943452540 Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:45:35.962735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bc5e5a0d29e43589d95be16c1fb464e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-VolumesActionsTest-1943452540 Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: 0bc5e5a0d29e43589d95be16c1fb464e Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-VolumesActionsTest-1943452540 Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-VolumesActionsTest-1943452540-project Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 8bdfee122af8429c9b8766949b781aee Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-VolumesActionsTest-1943452540-project Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance d2ced310-9bdb-499a-bf34-e762219e87d3 could not be found. Oct 24 13:45:35.963991 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'd2ced310-9bdb-499a-bf34-e762219e87d3'} Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ced310-9bdb-499a-bf34-e762219e87d3 could not be found. Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:45:35.964715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ced310-9bdb-499a-bf34-e762219e87d3 could not be found. Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ced310-9bdb-499a-bf34-e762219e87d3 could not be found. Oct 24 13:45:35.965887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:45:35.966993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] Returning 404 to user: Instance d2ced310-9bdb-499a-bf34-e762219e87d3 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:45:35.966993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ff2b3a39-a467-4719-b8bb-a19cedf0b862 tempest-VolumesActionsTest-1943452540 tempest-VolumesActionsTest-1943452540-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3" status: 404 len: 111 microversion: 2.1 time: 0.034096 Oct 24 13:45:35.966993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 302/585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:35 2022] GET /compute/v2.1/servers/d2ced310-9bdb-499a-bf34-e762219e87d3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:45:36.673172 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:36.674033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:36.680945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:36.681705 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:36.681903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:36.682530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:36.682978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:36.683391 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:36.815536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:36.824193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-babe2cad-4976-4d0c-84f5-255c85e979db tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1546 microversion: 2.1 time: 0.155095 Oct 24 13:45:36.824749 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 284/586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:36 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:36.846817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:36.847424 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:36.853855 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:36.854361 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:36.854790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:36.855463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:36.855906 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:36.856320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:36.983924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:36.992342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f594f468-9292-4da0-b5a6-69d20869c0ca tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1546 microversion: 2.1 time: 0.149308 Oct 24 13:45:36.992895 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 303/587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:36 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:37.014047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:37.018993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:37.019781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Searching by: {'deleted': False, 'project_id': '5243c296c8cb4467bfd269e4622e1adb'} {{(pid=125456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 13:45:37.026627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:37.027098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:37.027526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:37.028238 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:37.028679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:37.029094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:37.119064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.multi_cell_list [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 13:45:37.214605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5dfe9341-3d4c-4bd9-9131-1dad17a8dd0c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.204191 Oct 24 13:45:37.215180 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 285/588] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 24 13:45:37 2022] GET /compute/v2.1/servers => generated 341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:37.227324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:37.227933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:37.233848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:37.234366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:37.234805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:37.235488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:37.235944 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:37.236364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:37.372831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:37.380732 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2e008124-717b-4627-ab8e-8a7be1b0d603 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1546 microversion: 2.1 time: 0.157913 Oct 24 13:45:37.381533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 304/589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:37 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:41.578073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1832723074", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "networks": [{"uuid": "09a31875-0bfa-48d6-a9ef-86232d03c868"}]}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:41.631092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] validate_networks() for [('09a31875-0bfa-48d6-a9ef-86232d03c868', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:45:41.977692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:45:41.978116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:45:41.978656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:45:41.979065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:45:41.979504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:45:41.988292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.988772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.989207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:41.989933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:41.990481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:41.991406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:42.008492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Getting quotas for project b8ee40c2e5304b67b8814d34f3fe97b3. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:45:42.012546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Getting quotas for user 687126fda40f481cb5ba5d185cbfa74a and project b8ee40c2e5304b67b8814d34f3fe97b3. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:45:42.023696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:45:42.025970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:45:42.072648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5bbf460f-d6f9-4d0e-8790-e155c38903e9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498356 Oct 24 13:45:42.073299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 286/590] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:45:42.084571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-debfb4fe-4415-4dea-9324-c09e758bceea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:42.085187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-debfb4fe-4415-4dea-9324-c09e758bceea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:42.138724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-debfb4fe-4415-4dea-9324-c09e758bceea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:42.145866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-debfb4fe-4415-4dea-9324-c09e758bceea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1219 microversion: 2.1 time: 0.065038 Oct 24 13:45:42.146470 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 305/591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:42 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:43.169741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:43.170391 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:43.172307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:43.178654 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:43.179838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:43.180325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:43.181023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:43.181481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:43.181909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:43.244766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:43.252653 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b68814ec-e6b1-48d5-94fa-acfe05d35ec2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1223 microversion: 2.1 time: 0.087207 Oct 24 13:45:43.253215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 287/592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:43 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:43.256104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:43.256604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:43.263289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:43.263769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:43.264210 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:43.264882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:43.265334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:43.265760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:43.290863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0757516d-5a2b-482d-a236-0b8545110326 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/ips" status: 200 len: 146 microversion: 2.1 time: 0.038545 Oct 24 13:45:43.291436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 306/593] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:45:43 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:45:44.276514 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:44.277125 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:44.284011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:44.284489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:44.284920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:44.285603 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:44.286051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:44.286535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:44.350585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:44.358212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fe49c08f-9947-44f8-ac8d-c90aa3714aeb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1223 microversion: 2.1 time: 0.086301 Oct 24 13:45:44.358890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 288/594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:44 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:45.381178 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:45.381791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:45.388354 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:45.388830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:45.389265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:45.389947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:45.390424 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:45.390843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:45.451369 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:45.458981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4a0edcfd-044b-4ad3-83c6-8ffd1f147092 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1271 microversion: 2.1 time: 0.081676 Oct 24 13:45:45.459540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 307/595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:45 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:45:46.482881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:46.483549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:46.489580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:46.490053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:46.490570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:46.491247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:46.491693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:46.492933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:46.713508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:46.721291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9e2b3199-7d75-4d4d-a9a5-c2607b4a7563 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1319 microversion: 2.1 time: 0.242214 Oct 24 13:45:46.722029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 289/596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:46 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:46.893050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-3a371553-2822-411f-9519-75abbf64660f req-74554f3a-6082-4e0a-8664-5a08177b496c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e23c14-1796-426f-a15c-d53b91b9587b", "tag": "009b867c-0b99-47b1-ad9a-68902a5a05d1"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:46.903186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-3a371553-2822-411f-9519-75abbf64660f req-74554f3a-6082-4e0a-8664-5a08177b496c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:46.903665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-3a371553-2822-411f-9519-75abbf64660f req-74554f3a-6082-4e0a-8664-5a08177b496c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:46.904106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-3a371553-2822-411f-9519-75abbf64660f req-74554f3a-6082-4e0a-8664-5a08177b496c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:46.924373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-3a371553-2822-411f-9519-75abbf64660f req-74554f3a-6082-4e0a-8664-5a08177b496c service nova] Creating event network-changed:009b867c-0b99-47b1-ad9a-68902a5a05d1 for instance 20e23c14-1796-426f-a15c-d53b91b9587b on hv-cinder-86249 Oct 24 13:45:46.929217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-3a371553-2822-411f-9519-75abbf64660f req-74554f3a-6082-4e0a-8664-5a08177b496c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040118 Oct 24 13:45:46.930896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 308/597] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:46.981579 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:46.982214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:46.988725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:46.989392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:46.989822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:46.990558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:46.991006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:46.991472 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:47.017184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c8a47b85-5dfe-4948-b813-3a7688b6023d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/ips" status: 200 len: 148 microversion: 2.1 time: 0.039659 Oct 24 13:45:47.018001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 290/598] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:45:46 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:47.420119 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:47.423881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:47.437640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:47.438332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:47.438974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:47.439841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:47.440452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:47.441284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:47.472582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "370bab43-4912-47eb-8e3d-ac6e27615219"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:47.475237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:47.491129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:47.501663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:47.502147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:47.502916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:47.503383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:47.503805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:51.193189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1c2edec6-5ab7-418f-8cf0-28baea1788b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.724192 Oct 24 13:45:51.195873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 291/599] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:45:47 2022] POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-volume_attachments => generated 194 bytes in 3727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:51.201690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:51.202790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:51.212873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:51.213639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:51.214375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:51.216429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:51.217184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:51.218018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:51.236960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4a463387-fd1d-4558-85e0-601bdde2d064 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.826509 Oct 24 13:45:51.244504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 309/600] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:45:47 2022] POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments => generated 194 bytes in 3835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:51.270693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03dc6887-6062-4673-bd4f-3edfad4def3f"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:51.274246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:51.281358 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:51.283756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:51.284391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:51.285950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:51.286780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:51.287582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:51.287948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:51.592530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:51.596217 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:51.601864 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-be35ea1c-26eb-476a-a3ac-db100440e97c tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1319 microversion: 2.1 time: 0.403800 Oct 24 13:45:51.605384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 292/601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:51 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:51.618189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-733d85cf-bbb0-49c1-95a6-ad72c4f97698 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371129 Oct 24 13:45:51.624646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 310/602] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:45:51 2022] POST /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:45:52.629520 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:52.630131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:52.633087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=4 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:52.634557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:52.641365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:52.642066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:52.642584 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:52.643231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:52.643853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:52.644488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:52.823240 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:52.831577 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3de75fc0-a034-4d66-a5f7-fc85654f1c09 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1319 microversion: 2.1 time: 0.206285 Oct 24 13:45:52.832136 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 293/603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:52 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:53.856449 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:53.857146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:53.864122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:45:53.866996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:53.868158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:53.868821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:53.869761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:53.870452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:53.871335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:54.035900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:54.045734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-97e33d28-8bd9-485f-a4d6-aa294699d2c7 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1319 microversion: 2.1 time: 0.194489 Oct 24 13:45:54.046669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 311/604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:53 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:54.062977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-b48db59d-1cab-430c-86ac-17cd76097121 req-05a6d486-5825-4c10-a8f8-a150d605294d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e23c14-1796-426f-a15c-d53b91b9587b", "name": "network-vif-plugged", "status": "completed", "tag": "009b867c-0b99-47b1-ad9a-68902a5a05d1"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:54.077660 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-b48db59d-1cab-430c-86ac-17cd76097121 req-05a6d486-5825-4c10-a8f8-a150d605294d service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:54.078473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-b48db59d-1cab-430c-86ac-17cd76097121 req-05a6d486-5825-4c10-a8f8-a150d605294d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:54.079121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-b48db59d-1cab-430c-86ac-17cd76097121 req-05a6d486-5825-4c10-a8f8-a150d605294d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:54.094652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-b48db59d-1cab-430c-86ac-17cd76097121 req-05a6d486-5825-4c10-a8f8-a150d605294d service nova] Creating event network-vif-plugged:009b867c-0b99-47b1-ad9a-68902a5a05d1 for instance 20e23c14-1796-426f-a15c-d53b91b9587b on hv-cinder-86249 Oct 24 13:45:54.100652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-b48db59d-1cab-430c-86ac-17cd76097121 req-05a6d486-5825-4c10-a8f8-a150d605294d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041897 Oct 24 13:45:54.102372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 294/605] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:45:55.068949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:55.070304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:55.077201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:55.078655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:55.079336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:55.080123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:55.080657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:55.081147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:55.244574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:55.252741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0caac076-5697-4ba6-9cbf-d69da84d8efb tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1319 microversion: 2.1 time: 0.187751 Oct 24 13:45:55.254204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 312/606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:55 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:56.278120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:56.279040 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:56.300101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:56.300610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:56.301056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:56.301785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:56.302308 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:56.302736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:56.470497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:56.478654 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0ca43d66-cc08-4d7a-85f0-39518fe24eb9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1319 microversion: 2.1 time: 0.206137 Oct 24 13:45:56.479530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 295/607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:56 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:57.502534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:45:57.503249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:57.515959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:57.516440 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:57.516871 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:57.517682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:57.518137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:57.518571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:57.654273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:45:57.663537 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1e65d5d9-bda4-4052-b66e-23fff33fb3ea tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1509 microversion: 2.1 time: 0.164878 Oct 24 13:45:57.678492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 313/608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:45:57 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:45:57.686893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90da134c-3928-4382-a42b-7e0c762a15a0", "device": "/dev/sdb"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:45:57.690563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:45:57.698252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:57.698829 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:57.699333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:57.700159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:45:57.700683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:45:57.701177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:45:58.350019 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fe3d2e4e-9e2c-435e-87ac-62c6afd3c7b9 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "POST /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666871 Oct 24 13:45:58.350771 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 296/609] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:45:57 2022] POST /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:46:00.216243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:00.217486 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:00.224368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:00.225092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:00.225532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:00.226793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:00.227245 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:00.227665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:00.376962 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:00.386224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c1124276-75ab-440b-a39e-77330dce0083 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1592 microversion: 2.1 time: 0.173640 Oct 24 13:46:00.394292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 314/610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:00 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1592 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:02.306450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-3e6781bf-2883-4dba-be92-f5b86f2bf893 req-0cc686ef-7d3f-4c1f-b690-c9f3c1eb03db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:02.321097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3e6781bf-2883-4dba-be92-f5b86f2bf893 req-0cc686ef-7d3f-4c1f-b690-c9f3c1eb03db service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:02.321570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3e6781bf-2883-4dba-be92-f5b86f2bf893 req-0cc686ef-7d3f-4c1f-b690-c9f3c1eb03db service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:02.321994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3e6781bf-2883-4dba-be92-f5b86f2bf893 req-0cc686ef-7d3f-4c1f-b690-c9f3c1eb03db service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:02.335656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-3e6781bf-2883-4dba-be92-f5b86f2bf893 req-0cc686ef-7d3f-4c1f-b690-c9f3c1eb03db service nova] Creating event network-changed:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:46:02.342126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-3e6781bf-2883-4dba-be92-f5b86f2bf893 req-0cc686ef-7d3f-4c1f-b690-c9f3c1eb03db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040494 Oct 24 13:46:02.343398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 297/611] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:46:03.881628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1857243768"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:03.884096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:03.890853 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:03.891375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:03.891816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:03.892519 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:03.892974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:03.893399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:04.032811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.network.security_group_api [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Adding security group 66773652-b4a4-467f-ae43-3029fc2e7420 to port 7b7a8dbf-45be-45cc-bd21-3d784915e6d5 Oct 24 13:46:04.383416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-42d1f3da-16b2-4616-a1c1-14c330921d5c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.504498 Oct 24 13:46:04.383416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 315/612] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:46:03 2022] POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:46:04.392726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:04.393434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:04.399875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:04.400364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:04.400803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:04.401502 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:04.402038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:04.402737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:04.408284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-56733ab3-805e-4e9d-9dd6-6d87c885b61b req-0bcbf5b8-bc61-49ca-bdba-6ff4608837ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:04.418695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-56733ab3-805e-4e9d-9dd6-6d87c885b61b req-0bcbf5b8-bc61-49ca-bdba-6ff4608837ca service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:04.419500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-56733ab3-805e-4e9d-9dd6-6d87c885b61b req-0bcbf5b8-bc61-49ca-bdba-6ff4608837ca service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:04.420148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-56733ab3-805e-4e9d-9dd6-6d87c885b61b req-0bcbf5b8-bc61-49ca-bdba-6ff4608837ca service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:04.437287 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-56733ab3-805e-4e9d-9dd6-6d87c885b61b req-0bcbf5b8-bc61-49ca-bdba-6ff4608837ca service nova] Creating event network-changed:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:46:04.443101 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-56733ab3-805e-4e9d-9dd6-6d87c885b61b req-0bcbf5b8-bc61-49ca-bdba-6ff4608837ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039324 Oct 24 13:46:04.444081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 316/613] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:46:04.610896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:04.624328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-21c85674-597f-4c35-bad9-83aea4a87586 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1757 microversion: 2.1 time: 0.235736 Oct 24 13:46:04.630760 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 298/614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:04 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:06.524083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-494d52b4-349b-437f-b083-aaa0e9148d41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:06.531077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-494d52b4-349b-437f-b083-aaa0e9148d41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:06.531562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-494d52b4-349b-437f-b083-aaa0e9148d41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:06.531996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-494d52b4-349b-437f-b083-aaa0e9148d41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:06.559769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:06.597106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-494d52b4-349b-437f-b083-aaa0e9148d41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Going to try to stop instance {{(pid=125457) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 13:46:06.644277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-494d52b4-349b-437f-b083-aaa0e9148d41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action" status: 202 len: 0 microversion: 2.1 time: 0.125453 Oct 24 13:46:06.645089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 317/615] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:46:06 2022] POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:46:06.660060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:06.660700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:06.670326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:06.670807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:06.671247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:06.675091 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:06.675651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:06.676018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:06.849044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:06.858115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6e0198dc-d829-48d9-80a5-26921a7baaaa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.207426 Oct 24 13:46:06.864048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 299/616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:06 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:07.883462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:07.884170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:07.891035 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:07.891527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:07.891963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:07.892681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:07.893141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:07.893545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:08.031534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:08.040669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-010f983b-6e19-4927-8498-6ea700af6bca tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.162107 Oct 24 13:46:08.041162 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 318/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:07 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:09.064248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:09.064862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:09.071485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:09.071969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:09.072407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:09.073098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:09.073553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:09.073977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:09.205004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:09.213712 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5ac72dc6-a790-47df-9b1f-578531e8f7b8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.153332 Oct 24 13:46:09.214296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 300/618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:09 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:10.237332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:10.237944 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:10.245176 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:10.245662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:10.246227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:10.246929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:10.247386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:10.247813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:10.382502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:10.390696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5ff55de6-5165-4ed1-9e11-11071935bcb6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.157250 Oct 24 13:46:10.391265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 319/619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:10 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:11.414570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:11.415188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:11.421558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:11.422046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:11.422527 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:11.423247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:11.423711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:11.424127 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:11.553312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:11.561587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d0f86565-7f2e-4bf1-a143-83457bfd4d70 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.151083 Oct 24 13:46:11.562148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 301/620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:11 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:12.584813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:12.585774 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:12.592092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:12.592569 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:12.593001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:12.593673 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:12.594115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:12.594555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:12.728141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:12.736281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b35f5d8d-bfe8-4ee6-951e-6a92ac39a6e2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.155347 Oct 24 13:46:12.736861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 320/621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:12 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:13.759650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:13.760187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:13.762770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=30 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:13.768082 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:13.768568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:13.769009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:13.769700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:13.770153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:13.770599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:13.898440 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:13.908129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fb505d3c-7748-4c78-b5cf-90c274fe147f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.152427 Oct 24 13:46:13.908960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 302/622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:13 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:14.932181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:14.932785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:14.940041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:14.940556 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:14.940995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:14.941723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:14.942215 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:14.942644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:15.074947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:15.082942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-988e99d5-83ab-48d6-b089-864f6e95eb98 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.154691 Oct 24 13:46:15.083500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 321/623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:14 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:16.106996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:16.107513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:16.113856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:16.114390 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:16.114820 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:16.115500 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:16.115947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:16.116365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:16.254870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:16.264101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b3644c8a-4a7e-4c3c-bf19-e0b8e7ae8f6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.160982 Oct 24 13:46:16.264675 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 303/624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:16 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:16.405937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2bfa1d49-9a44-4263-8b14-e9e8b7bbdbea tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: .version_select at 0x7f8dc2892e50>, body: {"keypair": {"name": "tempest-keypair-1345662504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL0r87RuKlHVaVpPahWTmA+FQz2odjjCZ0hGX0o+i2FjlG8MQEu99jDem2iR29W0Imsj3yRsQOPCHx49SihU3ntacs65QQNkz9QpWphSbZ0AV6t56I9R3fM7KVMQbscJQ=="}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:16.422009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-2bfa1d49-9a44-4263-8b14-e9e8b7bbdbea tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:46:16.425822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-2bfa1d49-9a44-4263-8b14-e9e8b7bbdbea tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:46:16.438634 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2bfa1d49-9a44-4263-8b14-e9e8b7bbdbea tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [f9d6bfdd-38e2-4f3b-9177-6b9c0af31c28] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 13:46:17.289147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:17.289788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:17.296189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:17.296659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:17.297082 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:17.297754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:17.298221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:17.298635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:17.430201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:17.438411 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5eb5af9c-f4ba-4b1e-bd25-80d5d046e793 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.154126 Oct 24 13:46:17.438967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 304/625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:17 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:46:17.446933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO oslo.messaging._drivers.impl_rabbit [None req-2bfa1d49-9a44-4263-8b14-e9e8b7bbdbea tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [f9d6bfdd-38e2-4f3b-9177-6b9c0af31c28] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42180. Oct 24 13:46:17.462091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2bfa1d49-9a44-4263-8b14-e9e8b7bbdbea tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.059901 Oct 24 13:46:17.462669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 322/626] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:46:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:46:18.463304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:18.463916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:18.470033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:18.470545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:18.470990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:18.471679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:18.472132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:18.472557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:18.604815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:18.613200 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f4d978ca-aa46-46f9-84dc-7a4bdc1e19a3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.154448 Oct 24 13:46:18.613870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 305/627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:18 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:18.726920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-123331732", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "051d9444-c9f6-450e-99dd-61dcbd128cbe"}], "security_groups": [{"name": "tempest-securitygroup--601902156"}], "key_name": "tempest-keypair-1345662504", "user_data": "}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:18.829277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] validate_networks() for [('051d9444-c9f6-450e-99dd-61dcbd128cbe', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:46:19.203334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:46:19.203762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:46:19.204241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:46:19.204653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:46:19.205096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:46:19.214659 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:19.215142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:19.215574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:19.216300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:19.216754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:19.217183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:19.234795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:46:19.238770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:46:19.249787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:46:19.252110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:46:19.300050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-91881a78-49d5-43f2-86fb-4a0dd4bb5e4a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578063 Oct 24 13:46:19.300702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 323/628] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:46:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:46:19.311747 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4abf525c-bc6a-4c1a-a903-10bf309bc68e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:19.312359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4abf525c-bc6a-4c1a-a903-10bf309bc68e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:19.365857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4abf525c-bc6a-4c1a-a903-10bf309bc68e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:19.372710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4abf525c-bc6a-4c1a-a903-10bf309bc68e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1241 microversion: 2.1 time: 0.064747 Oct 24 13:46:19.373276 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 306/629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:19 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:19.637402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:19.638027 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:19.644362 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:19.644890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:19.645348 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:19.646041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:19.646526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:19.646955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:19.783676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:19.792167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-001b79e6-a06a-498d-b957-42b9459a4528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.158766 Oct 24 13:46:19.792726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 324/630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:19 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:20.395326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:20.395917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:20.402957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:20.403432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:20.403861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:20.404544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:20.404994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:20.405416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:20.470132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:20.477898 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d7560568-2a37-4484-a059-4b25004e3572 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1245 microversion: 2.1 time: 0.086545 Oct 24 13:46:20.478492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 307/631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:20 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:20.815384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:20.816028 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:20.823458 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:20.823929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:20.824356 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:20.825032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:20.825483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:20.825902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:20.951364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:20.959397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-00cdaf1a-9b30-48e9-8268-0f2041ebbc90 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.147819 Oct 24 13:46:20.960206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 325/632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:20 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:21.499650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:21.500273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:21.506964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:21.507764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:21.507949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:21.508636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:21.509079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:21.509501 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:21.573422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:21.581221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9c5a6dd7-3781-45b0-a6e5-0483666cf662 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1293 microversion: 2.1 time: 0.085388 Oct 24 13:46:21.581789 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 308/633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:21 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:21.983067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:21.983674 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:21.986189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:21.992141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:21.992623 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:21.993060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:21.993828 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:21.994316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:21.994761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:22.147001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:22.157892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-76eca090-bd4b-4fc9-b61c-dd8fd9704a93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.178768 Oct 24 13:46:22.174262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 326/634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:21 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:22.605098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:22.605785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:22.612229 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:22.612709 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:22.613135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:22.613817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:22.614289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:22.614701 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:22.707307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:22.709499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:22.716401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e424ed2d-83fb-4c07-abc2-596175fc0f12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1299 microversion: 2.1 time: 0.115853 Oct 24 13:46:22.716970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 309/635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:22 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:23.184720 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:23.185230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:23.191632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:23.192105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:23.192538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:23.193222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:23.193672 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:23.194136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:23.323310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:23.331385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1c218d9e-9f30-4f3f-86a0-808a3d477af8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.150609 Oct 24 13:46:23.331950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 327/636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:23 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:23.740824 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:23.742289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:23.749063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:23.749536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:23.749962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:23.750660 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:23.751107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:23.751521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:23.881468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:23.889674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1ba879eb-809c-4e3a-97f2-c428b195099b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.153203 Oct 24 13:46:23.890249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 310/637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:23 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:24.355346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:24.355893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:24.364469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:24.364979 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:24.365416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:24.366784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:24.367225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:24.367645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:24.514935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:24.523882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8facd1d2-3c82-4ac7-9f34-fe3cfaa4dc13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.172483 Oct 24 13:46:24.524453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 328/638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:24 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:24.912461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:24.913159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:24.919636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:24.920333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:24.920767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:24.921473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:24.921929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:24.922384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:24.957648 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-88409041-2e7d-476c-be6c-8ef32fcf23a2 req-688ac333-fdaa-4a78-a9c0-d8fbc0eeab17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91c938be-b9de-4df6-a185-4a2aab5f3be8", "tag": "ac820142-a7d5-46c3-84b5-fea1b233b86e"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:24.967981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-88409041-2e7d-476c-be6c-8ef32fcf23a2 req-688ac333-fdaa-4a78-a9c0-d8fbc0eeab17 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:24.968453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-88409041-2e7d-476c-be6c-8ef32fcf23a2 req-688ac333-fdaa-4a78-a9c0-d8fbc0eeab17 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:24.968881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-88409041-2e7d-476c-be6c-8ef32fcf23a2 req-688ac333-fdaa-4a78-a9c0-d8fbc0eeab17 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:24.979873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-88409041-2e7d-476c-be6c-8ef32fcf23a2 req-688ac333-fdaa-4a78-a9c0-d8fbc0eeab17 service nova] Creating event network-changed:ac820142-a7d5-46c3-84b5-fea1b233b86e for instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 on hv-cinder-86249 Oct 24 13:46:24.984950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-88409041-2e7d-476c-be6c-8ef32fcf23a2 req-688ac333-fdaa-4a78-a9c0-d8fbc0eeab17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030933 Oct 24 13:46:24.985548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 329/639] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:46:25.094211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:25.101863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b12395d8-b178-428d-ab4a-d9170f0e2dba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.193360 Oct 24 13:46:25.102459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 311/640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:24 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:25.548430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:25.549138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:25.556046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:25.556554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:25.556992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:25.557679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:25.558131 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:25.558575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:25.687587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:25.696076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-14185098-2437-4d87-92ad-eb9612ca8dd7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.151873 Oct 24 13:46:25.696632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 330/641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:25 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:26.124067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:26.124707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:26.131088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:26.131678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:26.132118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:26.132795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:26.133243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:26.133668 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:26.261855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:26.269424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a02a2500-d7b3-418d-bcfb-b3be0bde279e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.149235 Oct 24 13:46:26.269980 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 312/642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:26 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:26.719793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:26.720402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:26.726966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:26.727417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:26.727848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:26.728534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:26.728984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:26.729404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:26.859112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:26.868003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b060cef9-5641-466b-9b02-eac3a792e5af tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.152330 Oct 24 13:46:26.868567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 331/643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:26 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:27.292183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:27.292784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:27.299280 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:27.299764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:27.300203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:27.300897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:27.301353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:27.301776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:27.434419 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:27.442043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6bc46f99-9820-48ee-8d42-e55477bc2560 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.153800 Oct 24 13:46:27.442633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 313/644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:27 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:27.891977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:27.892608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:27.899800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:27.900280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:27.900715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:27.901400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:27.901851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:27.902300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:28.030156 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:28.038667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f032fa8e-2eb1-471f-b17b-28fe5a913f9c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.150544 Oct 24 13:46:28.039237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 332/645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:27 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:28.465212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:28.465825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:28.472192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:28.472669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:28.473105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:28.473838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:28.474421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:28.474951 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:28.608787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:28.617471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e2bde887-3ae6-46e0-82d5-3f5f15048e54 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.155317 Oct 24 13:46:28.618303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 314/646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:28 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:29.062052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:29.062701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:29.069335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:29.069850 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:29.070318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:29.071021 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:29.071478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:29.071905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:29.205286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:29.215650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5e917fb7-503b-4a96-90e4-018f85b4cc2d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.157321 Oct 24 13:46:29.216217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 333/647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:29 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:29.641682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:29.642421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:29.644349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:29.651315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:29.652061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:29.652617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:29.653416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:29.653958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:29.654409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:30.064578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:30.072933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2d8d4f41-139f-4ba3-bc69-5e6259ce61f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.435093 Oct 24 13:46:30.073509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 315/648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:29 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:30.239657 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:30.240266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:30.243818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:30.244545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=10 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:30.249844 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:30.250357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:30.250795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:30.251510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:30.251961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:30.252382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:30.389760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:30.399551 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-40bcf18b-ae8e-4090-a614-6156db7a5402 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.163650 Oct 24 13:46:30.400228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 334/649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:30 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:31.095736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:31.096253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:31.102848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:31.103333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:31.103766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:31.104459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:31.104913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:31.105333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:31.236745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:31.244875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f89c493f-1f99-47ff-9032-6970a85bb64b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.153058 Oct 24 13:46:31.245424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 316/650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:31 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:31.424842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:31.425370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:31.432477 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:31.432959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:31.433394 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:31.434081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:31.434558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:31.434986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:31.438863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:31.570141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:31.578762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ff00cc67-b40d-4602-ad58-ff4a5b90db0d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.157677 Oct 24 13:46:31.580146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 335/651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:31 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:32.268051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:32.268662 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:32.275847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:32.276323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:32.276755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:32.277437 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:32.277884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:32.278332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:32.403514 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:32.411458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5584c807-02b8-4aee-b907-34da4a228ab5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.147282 Oct 24 13:46:32.412017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 317/652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:32 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:32.600713 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:32.601768 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:32.607652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:32.608135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:32.608568 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:32.609267 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:32.609722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:32.610145 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:32.741024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:32.749670 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5fd24f2c-e8a9-476a-a28a-1f6409e242c2 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.152838 Oct 24 13:46:32.750251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 336/653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:32 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:33.433018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:33.433628 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:33.440047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:33.440525 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:33.440950 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:33.441626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:33.442069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:33.442508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:33.574957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:33.582481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dcd5cde8-5461-4354-8cb8-02df9c999135 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.153566 Oct 24 13:46:33.583059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 318/654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:33 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:33.774223 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:33.774774 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:33.781101 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:33.781581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:33.782303 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:33.782993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:33.783451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:33.783884 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:33.910652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:33.919227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-29e6ad51-c79c-4041-85bc-583191a68282 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.149523 Oct 24 13:46:33.919798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 337/655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:33 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:34.606119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:34.606759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:34.613336 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:34.613767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:34.614078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:34.614784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:34.615227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:34.615643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:34.742876 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:34.750280 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-266b3078-e8aa-445c-8dca-a6e69504d049 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.147932 Oct 24 13:46:34.750833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 319/656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:34 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:34.943649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:34.944180 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:34.951349 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:34.951822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:34.952246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:34.952925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:34.953371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:34.953790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:35.079276 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:35.087714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-57c02373-5894-44aa-af6c-8b518e984897 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.148023 Oct 24 13:46:35.088279 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 338/657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:34 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:35.773746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:35.774385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:35.780656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:35.781125 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:35.781552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:35.782519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:35.782953 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:35.783412 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:35.908979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:35.916532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1445253d-7109-4c38-91e6-c5ff2464d98f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.146988 Oct 24 13:46:35.917097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 320/658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:35 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:36.110682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:36.111292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:36.118535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:36.119016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:36.119448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:36.120135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:36.120586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:36.121012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:36.255068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:36.263501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bbbe9011-984c-4e0a-b73f-bf95d8894e17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.156724 Oct 24 13:46:36.264071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 339/659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:36 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:36.940496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:36.941061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:36.948073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:36.948559 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:36.948992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:36.949688 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:36.950136 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:36.950586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:37.081687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:37.089886 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e5011b5e-4d92-499d-a7d9-fe520e78777a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.154094 Oct 24 13:46:37.090481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 321/660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:36 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:37.286948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:37.287550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:37.294349 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:37.294828 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:37.295251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:37.295936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:37.296383 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:37.296801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:37.427187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:37.436028 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a520e468-ddb1-4394-bbd3-c8f9af37db01 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.152797 Oct 24 13:46:37.436600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 340/661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:37 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:38.112260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:38.112877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:38.119357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:38.119839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:38.120282 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:38.120969 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:38.121421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:38.121843 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:38.249371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:38.256910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-071b556f-138e-45d4-8d4a-7e9033b06d37 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.148528 Oct 24 13:46:38.257464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 322/662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:38 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:38.459916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:38.460437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:38.467494 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:38.467974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:38.468404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:38.469095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:38.469544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:38.469961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:38.600564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:38.608778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-940f4a5c-ace3-4032-bc27-2fa79a6bdb75 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.152745 Oct 24 13:46:38.609342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 341/663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:38 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:39.279955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:39.280655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:39.288140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:39.288616 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:39.289858 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:39.290245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:39.290698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:39.291126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:39.427167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:39.434953 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-48ea024b-d44f-48db-99d4-c3bdbd79dc4f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.158819 Oct 24 13:46:39.435511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 323/664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:39 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:39.633093 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:39.633697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:39.640634 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:39.641122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:39.641553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:39.642286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:39.642770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:39.643192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:39.792817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:39.800984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ae680921-5102-4d4f-ad40-d9e1aaf09c7f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.172103 Oct 24 13:46:39.801546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 342/665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:39 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:40.458495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:40.459131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:40.466160 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:40.466610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:40.467039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:40.467719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:40.468164 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:40.468581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:40.601456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:40.608930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-543ae630-dc98-4aca-80a2-b7aa8939183b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.154220 Oct 24 13:46:40.609480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 324/666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:40 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:40.824600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:40.825215 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:40.831846 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:40.832332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:40.832771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:40.833459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:40.833915 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:40.834376 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:40.963045 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:40.971170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-46109233-b860-4a74-8f74-8ce321a3e5a8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.150927 Oct 24 13:46:40.971675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 343/667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:40 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:41.631455 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:41.632043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:41.638722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:41.639196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:41.639622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:41.640300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:41.640744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:41.641155 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:41.768597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:41.776715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dc57d818-ea19-4060-8892-939ac8ac5112 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.149136 Oct 24 13:46:41.777276 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 325/668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:41 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:41.994906 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:41.995443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:42.001839 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:42.002353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:42.002792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:42.003478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:42.004012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:42.004441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:42.132129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:42.141034 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c6adeaab-c355-4c91-97af-c6532af5d826 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1725 microversion: 2.1 time: 0.149963 Oct 24 13:46:42.141595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 344/669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:41 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:42.799741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:42.800357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:42.807446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:42.807962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:42.808846 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:42.809074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:42.809532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:42.809957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:42.825067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:42.943783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:42.952117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-49fcd014-01d4-43a3-94ed-e49e02703f9e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.156243 Oct 24 13:46:42.952686 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 326/670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:42 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:43.165358 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:43.165955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:43.172350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.172845 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.173272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:43.173950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.174425 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.174842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:43.306476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:43.314500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-31e13c86-d764-4aaf-b368-11a9a63b7a1a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1702 microversion: 2.1 time: 0.153557 Oct 24 13:46:43.315054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 345/671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:43 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:43.337532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-30f6e979-cca2-4735-829d-8bb61bc1fdd3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:43.343589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30f6e979-cca2-4735-829d-8bb61bc1fdd3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.344055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30f6e979-cca2-4735-829d-8bb61bc1fdd3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.344484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-30f6e979-cca2-4735-829d-8bb61bc1fdd3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:43.404702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-30f6e979-cca2-4735-829d-8bb61bc1fdd3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Going to try to start instance {{(pid=125456) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 13:46:43.445049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-30f6e979-cca2-4735-829d-8bb61bc1fdd3 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action" status: 202 len: 0 microversion: 2.1 time: 0.112082 Oct 24 13:46:43.445645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 327/672] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:46:43 2022] POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:46:43.453624 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:43.454248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:43.460020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.460501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.461465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:43.462269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.462781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.463169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:43.603718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:43.611940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b5f14edf-48a8-4c0e-9a29-a76749b55c13 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1711 microversion: 2.1 time: 0.162069 Oct 24 13:46:43.612504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 346/673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:43 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:43.975559 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:43.976263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:43.979328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=54 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:43.985341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.985831 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.986291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:43.986989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:43.987446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:43.987865 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:44.184202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:44.192228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3215e14c-535f-420e-bf35-edc4878cbcf0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.220654 Oct 24 13:46:44.193058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 328/674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:43 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:44.635894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:44.636488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:44.642849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:44.643328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:44.643757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:44.644440 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:44.644890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:44.645457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:44.933244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:44.942009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f9e001a9-1b2d-46b3-a5b2-51e887c4c4d0 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1711 microversion: 2.1 time: 0.310196 Oct 24 13:46:44.942608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 347/675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:44 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1711 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:45.140423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-26422ac2-1dbb-40f3-a43b-fa91acdabdcb req-1ac7cbbb-7eeb-4f23-baa4-e93359555d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c938be-b9de-4df6-a185-4a2aab5f3be8", "name": "network-vif-plugged", "status": "completed", "tag": "ac820142-a7d5-46c3-84b5-fea1b233b86e"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:45.151407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-26422ac2-1dbb-40f3-a43b-fa91acdabdcb req-1ac7cbbb-7eeb-4f23-baa4-e93359555d89 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:45.151881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-26422ac2-1dbb-40f3-a43b-fa91acdabdcb req-1ac7cbbb-7eeb-4f23-baa4-e93359555d89 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:45.152310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-26422ac2-1dbb-40f3-a43b-fa91acdabdcb req-1ac7cbbb-7eeb-4f23-baa4-e93359555d89 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:45.166566 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-26422ac2-1dbb-40f3-a43b-fa91acdabdcb req-1ac7cbbb-7eeb-4f23-baa4-e93359555d89 service nova] Creating event network-vif-plugged:ac820142-a7d5-46c3-84b5-fea1b233b86e for instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 on hv-cinder-86249 Oct 24 13:46:45.171680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-26422ac2-1dbb-40f3-a43b-fa91acdabdcb req-1ac7cbbb-7eeb-4f23-baa4-e93359555d89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034920 Oct 24 13:46:45.172331 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 329/676] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:46:45.217321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:45.217982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:45.223854 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:45.224359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:45.224760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:45.225463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:45.225919 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:45.226731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:45.356429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:45.363926 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b9cfed13-4a43-4307-a05b-5994cb58bf3b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.150716 Oct 24 13:46:45.364483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 348/677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:45 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:45.965564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:45.966290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:45.972480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:45.972958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:45.973379 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:45.974048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:45.974513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:45.974928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:46.109488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:46.118780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2b56f891-539f-48fa-8bc0-2f5707ef0fba tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1715 microversion: 2.1 time: 0.157523 Oct 24 13:46:46.119341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 330/678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:45 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:46.386917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:46.387526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:46.394310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:46.394787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:46.395219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:46.395901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:46.396346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:46.396763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:46.528012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:46.535771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-48c9599b-9ddc-4eaf-8db1-0fadfbba734c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.152876 Oct 24 13:46:46.536320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 349/679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:46 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:47.423932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:47.424425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:47.431525 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:47.431998 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:47.432428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:47.433105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:47.433549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:47.433963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:47.558559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:47.559175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:47.565216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:47.565687 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:47.566116 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:47.566825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:47.567269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:47.567686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:47.655849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'services' on Instance uuid 20e23c14-1796-426f-a15c-d53b91b9587b {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:46:47.695599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:47.703328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c24005fd-442b-4ce3-adbd-de098f85227e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.149269 Oct 24 13:46:47.703892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 350/680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:47 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:46:47.769815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-04a4b3b2-bca8-43ed-bcc3-bb37251be5a2 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b/os-volume_attachments/90da134c-3928-4382-a42b-7e0c762a15a0" status: 202 len: 0 microversion: 2.1 time: 0.349364 Oct 24 13:46:47.770358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 331/681] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:46:47 2022] DELETE /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b/os-volume_attachments/90da134c-3928-4382-a42b-7e0c762a15a0 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:46:48.727104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:48.727785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:48.734070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:48.734583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:48.735016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:48.735702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:48.736153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:48.736577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:48.864492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:48.866694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:48.873901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3a2cc211-fc69-43f6-929c-e09ac5fca7ba tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1366 microversion: 2.1 time: 0.150600 Oct 24 13:46:48.874524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 351/682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:48 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:49.897755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:49.899063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:49.905337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:49.905811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:49.906267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:49.907208 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:49.907653 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:49.908067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:49.952633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:49.953177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:49.959736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:49.960222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:49.960658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:49.962025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:49.962510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:49.962932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:49.988664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:46:50.039144 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:50.047949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6c549ff0-3e93-4032-97b4-469e01ebc1b6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1555 microversion: 2.1 time: 0.154986 Oct 24 13:46:50.058631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 332/683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:49 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:50.064558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c1450253-8551-4be9-8a87-f3f972e83c86 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 204 len: 0 microversion: 2.1 time: 0.115792 Oct 24 13:46:50.065225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 352/684] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:46:49 2022] DELETE /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:46:50.071025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:50.071635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:50.073742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:50.074487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:50.077599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:50.078074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:50.078544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:50.079228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:50.079671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:50.080085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:50.080189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:50.080669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:50.081099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:50.081782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:50.082255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:50.082675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:50.165148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5149677b-bef4-4432-ba9c-21dc13e65f7e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098033 Oct 24 13:46:50.165901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 333/685] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:46:50 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:46:50.235080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:50.243104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-aa82fe22-d00e-4a6f-963a-60830c59c201 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1515 microversion: 2.1 time: 0.173796 Oct 24 13:46:50.243946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 353/686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:50 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:46:51.088080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:46:51.088589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Mon Oct 24 13:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 24 13:46:51.093304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-0e879089-a0d3-4151-8802-3d05f764e322 req-3ae37bc4-44c7-4bf1-863f-4974a4eea550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91c938be-b9de-4df6-a185-4a2aab5f3be8", "tag": "ac820142-a7d5-46c3-84b5-fea1b233b86e"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:51.104722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0e879089-a0d3-4151-8802-3d05f764e322 req-3ae37bc4-44c7-4bf1-863f-4974a4eea550 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:51.105388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0e879089-a0d3-4151-8802-3d05f764e322 req-3ae37bc4-44c7-4bf1-863f-4974a4eea550 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:51.105821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0e879089-a0d3-4151-8802-3d05f764e322 req-3ae37bc4-44c7-4bf1-863f-4974a4eea550 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:51.117185 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-0e879089-a0d3-4151-8802-3d05f764e322 req-3ae37bc4-44c7-4bf1-863f-4974a4eea550 service nova] Creating event network-changed:ac820142-a7d5-46c3-84b5-fea1b233b86e for instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 on hv-cinder-86249 Oct 24 13:46:51.122698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-0e879089-a0d3-4151-8802-3d05f764e322 req-3ae37bc4-44c7-4bf1-863f-4974a4eea550 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036277 Oct 24 13:46:51.123288 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 334/687] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:46:51.266489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:51.267098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:51.273669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:51.274202 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:51.274638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:51.275323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:51.275767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:51.276181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:51.412214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:51.421013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3f5dea44-199a-41d7-a386-8d9fb5c83f72 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1515 microversion: 2.1 time: 0.158370 Oct 24 13:46:51.421596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 354/688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:51 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:52.445318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:52.445918 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:52.452004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:52.452484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:52.452917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:52.453611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:52.454062 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:52.454539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:52.658665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:52.666376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c74a2129-bbee-4a1b-bb42-964170729d23 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1515 microversion: 2.1 time: 0.225909 Oct 24 13:46:52.666941 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 335/689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:52 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:53.380099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-a0144122-1f04-449d-b5d5-8ba2319a05a2 req-5085a3ab-5cc5-4d06-8e2b-1eb6597a770d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e23c14-1796-426f-a15c-d53b91b9587b", "name": "network-vif-deleted", "tag": "009b867c-0b99-47b1-ad9a-68902a5a05d1"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:46:53.386969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:46:53.391186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-a0144122-1f04-449d-b5d5-8ba2319a05a2 req-5085a3ab-5cc5-4d06-8e2b-1eb6597a770d service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:53.391663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-a0144122-1f04-449d-b5d5-8ba2319a05a2 req-5085a3ab-5cc5-4d06-8e2b-1eb6597a770d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:53.392092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-a0144122-1f04-449d-b5d5-8ba2319a05a2 req-5085a3ab-5cc5-4d06-8e2b-1eb6597a770d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:53.404161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-a0144122-1f04-449d-b5d5-8ba2319a05a2 req-5085a3ab-5cc5-4d06-8e2b-1eb6597a770d service nova] Creating event network-vif-deleted:009b867c-0b99-47b1-ad9a-68902a5a05d1 for instance 20e23c14-1796-426f-a15c-d53b91b9587b on hv-cinder-86249 Oct 24 13:46:53.409409 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-a0144122-1f04-449d-b5d5-8ba2319a05a2 req-5085a3ab-5cc5-4d06-8e2b-1eb6597a770d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Oct 24 13:46:53.410005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 355/690] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:46:53.689263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:53.689935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:53.696644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:53.697134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:53.697570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:53.698294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:53.698778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:53.699234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:53.731582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:53.732066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:53.732510 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:53.732939 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lazy-loading 'fault' on Instance uuid 20e23c14-1796-426f-a15c-d53b91b9587b {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:46:53.774515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687126fda40f481cb5ba5d185cbfa74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee40c2e5304b67b8814d34f3fe97b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:46:53.782327 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e45e327c-a600-4cdf-bd83-77852dab07d3 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 200 len: 1309 microversion: 2.1 time: 0.096618 Oct 24 13:46:53.782880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 336/691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:53 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:46:54.807959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:54.808662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] [instance: 20e23c14-1796-426f-a15c-d53b91b9587b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:46:54.814837 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:54.815319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:54.815941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:54.816647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:46:54.817255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:46:54.817519 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:46:54.831409 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] HTTP exception thrown: Instance 20e23c14-1796-426f-a15c-d53b91b9587b could not be found. Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Request method failure captured: Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b HTTP/1.1 Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpZ4OGlWQqbBkkqUCrK1wLyPY03_GygTywWWywwCnf_Q6x15jtiSnMhaBdIW60NItl6i1kM174wwPsji4HVu-AVhtM2yj5ROBg32v62pTao-L-hQq96i3zYchPJhQ88GjrIymivWrygzjyJbiLrQseUCwfbdkEKdID3hS7AsKKc2zPk Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: b8ee40c2e5304b67b8814d34f3fe97b3 Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2070870729 Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:46:54.833102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8ee40c2e5304b67b8814d34f3fe97b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-VolumesSnapshotTestJSON-2070870729 Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: b8ee40c2e5304b67b8814d34f3fe97b3 Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2070870729 Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-VolumesSnapshotTestJSON-2070870729-project Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 687126fda40f481cb5ba5d185cbfa74a Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-VolumesSnapshotTestJSON-2070870729-project Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 20e23c14-1796-426f-a15c-d53b91b9587b could not be found. Oct 24 13:46:54.834714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '20e23c14-1796-426f-a15c-d53b91b9587b'} Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e23c14-1796-426f-a15c-d53b91b9587b could not be found. Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:46:54.838889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e23c14-1796-426f-a15c-d53b91b9587b could not be found. Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e23c14-1796-426f-a15c-d53b91b9587b could not be found. Oct 24 13:46:54.841197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:46:54.842605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] Returning 404 to user: Instance 20e23c14-1796-426f-a15c-d53b91b9587b could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:46:54.842605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1e38fe68-d34b-440b-bcd4-46b937f82359 tempest-VolumesSnapshotTestJSON-2070870729 tempest-VolumesSnapshotTestJSON-2070870729-project] 10.222.0.20 "GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b" status: 404 len: 111 microversion: 2.1 time: 0.031963 Oct 24 13:46:54.842605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 356/692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:46:54 2022] GET /compute/v2.1/servers/20e23c14-1796-426f-a15c-d53b91b9587b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:46:59.993619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:46:59.994257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:00.000901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:00.001371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:00.001793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:00.002491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:00.002937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:00.003350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:00.027133 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2321c444-8d90-478d-bc7b-0a76806c444f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037597 Oct 24 13:47:00.027692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 337/693] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Oct 24 13:46:59 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:47:03.212989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:47:03.213534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:03.220835 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:03.221522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:03.222130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:03.223049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:03.223646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:03.224198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:03.249550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lazy-loading 'flavor' on Instance uuid 586f4ffe-7aa6-4602-a4bd-48b62c92198f {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:47:03.479486 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-895d6385-6153-4da4-b2aa-d7d0a4b08cd5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/action" status: 202 len: 0 microversion: 2.20 time: 0.270506 Oct 24 13:47:03.481722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 357/694] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 24 13:47:03 2022] POST /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:47:03.488604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:03.489203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:03.496229 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:03.496714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:03.497127 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:03.497851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:03.498274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:03.498693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:03.631425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:03.639661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:03.641088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:03.642260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f8527bd2-eb63-474d-bfc0-cd5e648f1355 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.157596 Oct 24 13:47:03.642812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 338/695] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:03 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:04.670549 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:04.671247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:04.677988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:04.678498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:04.678934 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:04.680378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:04.680867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:04.681293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:04.811538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:04.819664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:04.821222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:04.822417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c644bc3a-0b02-4298-b186-135ab7b1e41c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.156757 Oct 24 13:47:04.822977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 358/696] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:04 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:05.847766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:05.848616 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:05.856398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:05.856872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:05.857302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:05.857984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:05.858464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:05.858883 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:05.987251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:05.995957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:05.997380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:05.998557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8097c98d-4092-41ee-82f3-a545088f88b4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.154656 Oct 24 13:47:05.999106 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 339/697] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:05 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:07.025135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:07.025741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:07.032350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:07.032825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:07.033253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:07.033929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:07.034406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:07.034825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:07.163391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:07.172034 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:07.173468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:07.174661 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d5fed3b4-fdcf-409c-b148-5325f3e7334a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.154396 Oct 24 13:47:07.175222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 359/698] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:07 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:08.200495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:08.201131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:08.208105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:08.208944 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:08.209533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:08.210272 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:08.210907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:08.211479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:08.356697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:08.365245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:08.366839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:08.368893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a643420a-d548-4b1c-9f65-6cd30ea565d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.172223 Oct 24 13:47:08.369471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 340/699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:08 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:09.395059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:09.395689 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:09.402085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:09.402604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:09.403031 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:09.403701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:09.404146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:09.404560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:09.531203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:09.540113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:09.541547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:09.542722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bf19ac9f-9252-43c7-9737-42275bdc8976 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.151616 Oct 24 13:47:09.543277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 360/700] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:09 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:10.568852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:10.569491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:10.576745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:10.577215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:10.577646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:10.578356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:10.578808 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:10.579221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:10.710545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:10.719774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:10.721221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:10.722413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c1c74df6-1fb4-4572-9a0a-0ad4650dd527 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.157485 Oct 24 13:47:10.723075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 341/701] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:10 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:11.747921 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:11.748528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:11.754971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:11.755449 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:11.755881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:11.756564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:11.757013 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:11.757433 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:11.887241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:11.895239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:11.896681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:11.897827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-da4c9e72-619b-4909-ba34-24a9abfd1eee tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.154037 Oct 24 13:47:11.898925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 361/702] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:11 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:12.925890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:12.926523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:12.933600 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:12.934108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:12.934533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:12.935220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:12.935666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:12.936080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:12.940150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:13.074643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:13.082547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:13.083968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:13.085096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ede7e896-7458-48f5-b58a-3439534f6f56 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.163080 Oct 24 13:47:13.085644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 342/703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:12 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:14.111833 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:14.112442 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:14.119174 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:14.119663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:14.120142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:14.120898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:14.121385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:14.121789 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:14.250709 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:14.258734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:14.260179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:14.261865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d5fdd922-0fa8-4db4-8491-ca7fda4f648a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.153921 Oct 24 13:47:14.262454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 362/704] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:14 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:15.288452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:15.289062 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:15.291420 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=32 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:15.297130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:15.297602 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:15.298032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:15.298737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:15.299187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:15.299601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:15.427949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:15.436108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:15.437557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:15.438793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-898b1dcd-cd9b-42a6-9b75-445e704a1dea tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.154207 Oct 24 13:47:15.439724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 343/705] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:15 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:16.464807 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:16.465415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:16.471867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:16.472346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:16.472808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:16.473503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:16.473953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:16.474408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:16.603439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:16.611927 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:16.613371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:16.614563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2cde54a8-deb8-42ac-a69a-cb352c31f4a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.153893 Oct 24 13:47:16.615130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 363/706] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:16 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:17.641006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:17.641611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:17.647993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:17.648470 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:17.648902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:17.649593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:17.650044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:17.650496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:17.779909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:17.788078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:17.789519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:17.790701 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cd8b03d9-08b6-4457-984f-388eb99ab131 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.153588 Oct 24 13:47:17.791261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 344/707] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:17 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:18.816391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:18.817003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:18.823930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:18.824404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:18.824838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:18.825528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:18.825983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:18.826430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:18.952921 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:18.960985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:18.962453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:18.963608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b8f7c3d3-4ef5-4810-84a8-1b3e2d682421 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.151152 Oct 24 13:47:18.964826 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 364/708] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:18 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:19.989398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:19.989942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:19.996475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:19.996955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:19.997383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:19.998081 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:19.998623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:19.999033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:20.129474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:20.137617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:20.139092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:20.140233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4ce76cf0-9557-4492-913c-788fae869077 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.154846 Oct 24 13:47:20.140788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 345/709] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:19 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:21.166238 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:21.166888 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:21.173288 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:21.173774 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:21.174241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:21.174938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:21.175393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:21.175820 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:21.180323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:21.323971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:21.332169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:21.333593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:21.334831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-330bb51b-8bab-4752-9810-3d07d3eea53e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.172512 Oct 24 13:47:21.335330 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 365/710] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:21 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:22.361529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:22.362126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:22.368541 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:22.369009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:22.369434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:22.370106 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:22.371035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:22.371461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:22.500231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:22.508170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:22.509618 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:22.511458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-926e8f23-3c35-4650-a54c-9bf6ce057128 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.153198 Oct 24 13:47:22.512053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 346/711] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:22 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:23.537532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:23.538051 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:23.540342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=22 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:23.546189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:23.546674 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:23.547112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:23.547798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:23.548250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:23.548673 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:23.676289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:23.684506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:23.685943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:23.687127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-748b6d24-c1dc-4ee2-8b74-85bd200866e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.153695 Oct 24 13:47:23.687681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 366/712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:23 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:24.712343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:24.712940 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:24.719845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:24.720320 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:24.720748 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:24.721442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:24.721870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:24.722319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:25.010338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:25.018568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:25.019993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:25.021131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dfb6adec-e24d-4761-8af4-bc27a7115606 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.312638 Oct 24 13:47:25.021674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 347/713] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:24 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:26.047560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:26.048168 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:26.054472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:26.054959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:26.055396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:26.056084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:26.056535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:26.056958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:26.183645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:26.191543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:26.192974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:26.194127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-120dca7d-c320-400b-8209-e0a352a00251 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.150643 Oct 24 13:47:26.194728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 367/714] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:26 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:27.220003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:27.220726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:27.227156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:27.227708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:27.228153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:27.228833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:27.229307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:27.229833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:27.358041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:27.366407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:27.367872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:27.369024 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1fc60968-eccf-4155-b59d-c3ba27639eb3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.153018 Oct 24 13:47:27.370663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 348/715] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:27 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:28.396238 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:28.396826 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:28.404273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:28.404759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:28.405197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:28.405898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:28.406380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:28.407055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:28.539201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:28.547188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:28.548621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:28.549773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-27e7d83c-079f-45bc-a5dd-c0158b12f294 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.157491 Oct 24 13:47:28.550359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 368/716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:28 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:29.506512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-825a02af-fca4-4962-b5a1-08b6f58ae2dd req-3448d377-655f-4df2-a384-bc89cc3d0916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "name": "network-vif-plugged", "status": "completed", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:47:29.516061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-825a02af-fca4-4962-b5a1-08b6f58ae2dd req-3448d377-655f-4df2-a384-bc89cc3d0916 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:29.516528 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-825a02af-fca4-4962-b5a1-08b6f58ae2dd req-3448d377-655f-4df2-a384-bc89cc3d0916 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:29.516948 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-825a02af-fca4-4962-b5a1-08b6f58ae2dd req-3448d377-655f-4df2-a384-bc89cc3d0916 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:29.528314 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-825a02af-fca4-4962-b5a1-08b6f58ae2dd req-3448d377-655f-4df2-a384-bc89cc3d0916 service nova] Creating event network-vif-plugged:07c0c60c-b6e6-4992-af52-d3d7c785897b for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f on hv-cinder-86249 Oct 24 13:47:29.533560 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-825a02af-fca4-4962-b5a1-08b6f58ae2dd req-3448d377-655f-4df2-a384-bc89cc3d0916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207592 Oct 24 13:47:29.534111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 349/717] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:47:29.575180 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:29.575776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:29.582070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:29.582574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:29.583008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:29.583687 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:29.584130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:29.584543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:29.710905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:29.719653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:29.721069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:29.722257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-316ffbda-08ff-468c-a534-02e66322485e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.151118 Oct 24 13:47:29.722821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 369/718] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:29 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:30.749725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:30.750448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:30.756556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:30.757034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:30.757465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:30.758146 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:30.758621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:30.759044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:30.888819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:30.896845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:30.898271 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:30.899410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6d0706d1-386f-46c5-afc5-0c7849e4c03b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.155012 Oct 24 13:47:30.899958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 350/719] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:30 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:31.924412 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:31.925049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:31.931573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:31.932086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:31.932515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:31.933228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:31.934403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:31.934918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:32.064283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:32.072189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:32.073619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:32.075719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-07b85931-ccec-4302-a474-3b479da7dfa1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.155248 Oct 24 13:47:32.076274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 370/720] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:31 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:47:33.101343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:33.101873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:33.108296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:33.108777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:33.109210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:33.109900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:33.110378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:33.110804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:33.238274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:33.246984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:33.248425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:33.249582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-556a1a2e-9971-4ff7-a6d2-71a2fdb8d99a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1745 microversion: 2.20 time: 0.152172 Oct 24 13:47:33.250138 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 351/721] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:33 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:34.275715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:34.278088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:34.284728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:34.285524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:34.286159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:34.287507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:34.288084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:34.288611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:34.435573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:34.444868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:34.446723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:34.448239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7d9a6fe2-168c-445b-9b84-d79d10affe20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.177063 Oct 24 13:47:34.450254 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 371/722] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:34 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:35.476869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:35.477407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:35.484793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:35.485289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:35.485932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:35.486671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:35.487308 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:35.487906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:35.627807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:35.636580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:35.638017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:35.639226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0fac885e-daee-4a14-891a-07170ade420e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.166325 Oct 24 13:47:35.639958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 352/723] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:35 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:36.667887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:36.668737 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:36.676416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:36.678990 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:36.679109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:36.680341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:36.680526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:36.681443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:36.820776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:36.831428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:36.832866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:36.834068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1edadbd1-a3e0-4b91-b209-392477b8811d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.170412 Oct 24 13:47:36.834730 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 372/724] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:36 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:37.861051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:37.861952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:37.868816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:37.869290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:37.869720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:37.870429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:37.871078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:37.871689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:38.020735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:38.029691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:38.031358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:38.032798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9a70135f-1929-4601-b53a-328d7569cf37 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.176154 Oct 24 13:47:38.033345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 353/725] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:37 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:39.064728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:39.065851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:39.074476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:39.074959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:39.075396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:39.076142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:39.076599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:39.077021 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:39.212559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:39.224307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:39.225796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:39.227007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c354a995-c0c0-4201-92fd-5a87661519b2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.168927 Oct 24 13:47:39.227852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 373/726] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:39 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:40.253979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:40.254608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:40.261312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:40.261790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:40.262248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:40.262943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:40.263468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:40.264425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:40.408647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:40.417089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:40.418682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:40.421313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6410eb0a-8c2b-48a8-92d8-a7ff6799809f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.170647 Oct 24 13:47:40.421875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 354/727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:40 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:41.448862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:41.449473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:41.456725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:41.457210 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:41.457679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:41.458413 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:41.458881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:41.459378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:41.597202 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:41.605967 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:41.607567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:41.609106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e78020c4-a0cf-42ff-8275-86fd473b7e34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.164151 Oct 24 13:47:41.609950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 374/728] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:41 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:42.635372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:42.636110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:42.643074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:42.643556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:42.644002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:42.644694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:42.645149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:42.645577 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:42.786856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:42.796266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:42.797881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:42.799132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b002c841-4444-43c3-a979-bd3d6e3993bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.167663 Oct 24 13:47:42.806413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 355/729] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:42 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:43.828217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:43.828853 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:43.835385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:43.835863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:43.836425 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:43.837122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:43.837572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:43.837993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:44.002187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:44.012667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:44.025047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:44.026503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-db1bd38d-928f-4c58-b3c2-d96565d29496 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.202907 Oct 24 13:47:44.035436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 375/730] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:43 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:45.052646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:45.054196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:45.061816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:45.062272 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:45.062786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:45.063696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:45.064223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:45.064717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:45.067870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=80 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:45.206214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:45.217423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:45.219749 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:45.221072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dddff0ca-1c60-499d-9c9e-ddd6d2645ed9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.172678 Oct 24 13:47:45.234508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 356/731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:45 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:46.249623 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:46.250453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:46.256803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:46.257277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:46.257706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:46.258417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:46.258989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:46.259411 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:46.388029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:46.398187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:46.401126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:46.403354 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-79ee9733-a631-436d-8876-dcf154477ce3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1740 microversion: 2.20 time: 0.158218 Oct 24 13:47:46.405004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 376/732] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:46 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:47:47.430197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:47.430848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:47.432856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=28 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:47.438717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:47.439197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:47.439629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:47.440314 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:47.440765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:47.441180 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:47.652820 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:47.661898 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:47.663367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:47.664537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-132dfb7c-2842-4538-b1f9-d644e422db5a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1722 microversion: 2.20 time: 0.238238 Oct 24 13:47:47.665087 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 357/733] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:47 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:48.691615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:48.692216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:48.698678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:48.699147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:48.699577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:48.700254 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:48.700697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:48.701114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:48.831157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:48.839052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:48.840472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:48.841608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-61b4c200-0134-413e-a661-5598604b73ce tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1722 microversion: 2.20 time: 0.153948 Oct 24 13:47:48.842341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 377/734] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:48 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:47:49.867471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:49.868088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:49.875412 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:49.875888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:49.876325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:49.877137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:49.877595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:49.878016 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.010655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:50.018806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:50.020253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:50.021398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-277a8c09-0c23-4418-980d-c3962eae6e23 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1725 microversion: 2.20 time: 0.157935 Oct 24 13:47:50.022077 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 358/735] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:49 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:50.047949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "491ee443-3dc7-446f-a259-1b97d0734b5d"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:47:50.050291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:50.056655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:50.057285 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:50.057721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.058436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:50.058887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:50.059312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.347164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-67df6535-2e51-4e00-9726-9dd74e702111 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303928 Oct 24 13:47:50.347769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 378/736] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 24 13:47:50 2022] POST /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:47:50.473781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:47:50.474396 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:50.480226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:50.480700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:50.481129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.481806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:50.482275 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:50.482691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.568018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125456) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:47:50.636192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e19b6309-a06d-4253-b44c-08474e0dc92f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/action" status: 202 len: 0 microversion: 2.20 time: 0.166194 Oct 24 13:47:50.636828 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 359/737] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 24 13:47:50 2022] POST /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:47:50.645841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:50.646581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:50.653471 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:50.654039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:50.654563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.655510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:50.656114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:50.656869 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:50.660982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:50.788199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:50.797781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:50.799339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:50.800496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7f0ad055-527c-462d-aace-9b588952d83e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1751 microversion: 2.20 time: 0.158624 Oct 24 13:47:50.801047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 379/738] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:50 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:51.392504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-36ddd70b-162a-4a9a-a493-8fe41efcc78e req-845c9156-96b9-4f83-8dc7-a927f4b92c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "name": "network-vif-unplugged", "status": "completed", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:47:51.402936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-36ddd70b-162a-4a9a-a493-8fe41efcc78e req-845c9156-96b9-4f83-8dc7-a927f4b92c2e service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:51.403045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-36ddd70b-162a-4a9a-a493-8fe41efcc78e req-845c9156-96b9-4f83-8dc7-a927f4b92c2e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:51.403435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-36ddd70b-162a-4a9a-a493-8fe41efcc78e req-845c9156-96b9-4f83-8dc7-a927f4b92c2e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:51.415044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.compute.server_external_events [req-36ddd70b-162a-4a9a-a493-8fe41efcc78e req-845c9156-96b9-4f83-8dc7-a927f4b92c2e service nova] Unable to find a host for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f. Dropping event network-vif-unplugged {{(pid=125456) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 13:47:51.415915 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-36ddd70b-162a-4a9a-a493-8fe41efcc78e req-845c9156-96b9-4f83-8dc7-a927f4b92c2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028749 Oct 24 13:47:51.416492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 360/739] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 13:47:51.827806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:51.828414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:51.834880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:51.835353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:51.835781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:51.836463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:51.836913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:51.837333 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:51.969771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:51.978417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:51.979862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:51.981048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4c6581b9-9aab-45af-9e03-eb9bfc114b16 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1753 microversion: 2.20 time: 0.157145 Oct 24 13:47:51.981614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 380/740] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:51 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:53.007582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:53.008188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:53.014666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:53.015140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:53.016140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:53.017255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:53.017737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:53.018206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:53.224147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:53.232645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:53.234661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:53.236303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1350cf25-0e7e-456b-ba0c-0a163c082867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.232615 Oct 24 13:47:53.236857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 361/741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:53 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:54.262428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:54.262973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:54.265241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=30 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:47:54.271246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:54.271729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:54.272187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:54.272880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:54.273329 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:54.273763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:54.426064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:54.436668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:54.438811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:54.440133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fb6c51f6-add5-4c1c-99c5-aa68305713b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.181670 Oct 24 13:47:54.440921 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 381/742] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:54 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:55.469295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:55.469925 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:55.476870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:55.477563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:55.478002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:55.478911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:55.479367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:55.479793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:55.632619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:55.642682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:55.644123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:55.645283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b6c51133-d917-4fad-966d-f73f250485b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.180897 Oct 24 13:47:55.645832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 362/743] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:55 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:56.672492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:56.673286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:56.679076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:56.679565 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:56.680004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:56.680708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:56.681165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:56.681593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:56.813435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:56.822283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:56.823734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:56.824893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-56ca2b00-9a3c-45e2-99c5-482888c882b0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.157188 Oct 24 13:47:56.825460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 382/744] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:56 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:57.862903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:57.863728 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:57.873450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:57.874018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:57.874549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:57.876080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:57.876729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:57.877224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:57.982415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28f3c23f-aa6c-4494-b15a-cef9d0817c49"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:47:57.985490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:57.991541 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:57.992053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:57.992492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:57.993194 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:57.993651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:57.994080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:58.018809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:58.027865 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:58.029183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:58.030370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-36f039e9-2828-46fd-a2a3-96eb08d1626b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.182483 Oct 24 13:47:58.030921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 363/745] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:57 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:47:59.057221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:47:59.057999 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:47:59.064812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:59.065389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:59.065906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:59.066706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:47:59.067255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:47:59.067748 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:47:59.198974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:59.208173 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:59.209612 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:47:59.210816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c2058539-d298-4d9d-ad3e-24d516f117a7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.157555 Oct 24 13:47:59.211661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 364/746] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:47:59 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:00.239737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:00.241745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:00.250842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:00.251430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:00.252190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:00.252966 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:00.253630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:00.254118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:00.388499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:00.397609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:00.399063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:00.400212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9299c132-e8f4-4a58-bbdc-4570ae39fb17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.166919 Oct 24 13:48:00.400758 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 365/747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:00 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:01.427717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:01.429084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:01.435816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:01.436302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:01.436740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:01.438022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:01.438526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:01.438940 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:01.574711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:01.583660 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:01.585093 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:01.586278 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1a32df33-5fb8-4021-9b68-8ee13a9ad7a6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.162435 Oct 24 13:48:01.586812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 366/748] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:01 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:02.403568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:02.405763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:02.412675 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:02.413156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:02.413590 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:02.414470 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:02.414925 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:02.415349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:02.487662 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3b14cf07-8f4d-42c7-aaf1-5ecea1fd3cd4 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.088535 Oct 24 13:48:02.488349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 367/749] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:48:02 2022] POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:48:02.496436 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:02.497130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:02.503110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:02.503590 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:02.504023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:02.504713 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:02.505166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:02.505588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:02.661977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:02.671341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8215cc5f-4e03-42e4-9cb8-382d4a436f13 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.178712 Oct 24 13:48:02.673129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 368/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:02 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:02.677977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:02.678870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:02.684955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:02.685508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:02.686010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:02.686826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:02.687891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:02.688332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:02.815945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:02.824465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:02.825892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:02.827065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e970a47b-69aa-404c-8cc8-8501abb375f1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.152947 Oct 24 13:48:02.827613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 369/751] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:02 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:03.697004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:03.697707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:03.704307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:03.704792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:03.705228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:03.705923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:03.706407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:03.706834 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:03.864319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:03.872604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-28834fbf-35ee-4a98-8ff0-8404d27a4b62 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.179406 Oct 24 13:48:03.873177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 370/752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:03 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:03.878367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:03.878871 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:03.884681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:03.885165 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:03.885605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:03.886319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:03.886784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:03.887342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:03.902842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:04.018141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:04.026774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:04.028244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:04.029405 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cd7ffd4d-81be-45a4-ae0b-3e6878076e68 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.155315 Oct 24 13:48:04.029967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 371/753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:03 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:04.896693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:04.897336 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:04.904300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:04.904803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:04.905232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:04.906763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:04.907246 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:04.907690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:05.053998 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:05.062300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-165e78db-50de-49cb-8c2f-193355a302f3 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.169609 Oct 24 13:48:05.062860 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 372/754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:04 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:05.067485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:05.068086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:05.073655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:05.074179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:05.074626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:05.075307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:05.075759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:05.076179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:05.205723 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:05.214648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:05.216092 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:05.217255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b9a59647-0a17-4d3b-9d5e-c27be918af36 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.153420 Oct 24 13:48:05.217811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 373/755] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:05 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:05.773616 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:05.774108 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:05.780115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:05.780629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:05.781118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:05.782341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:05.782798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:05.783223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:05.862384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lazy-loading 'services' on Instance uuid b4bf2855-1081-401a-a540-af8ef43dc1c8 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:48:05.934576 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9a4e9eb3-599b-442e-8767-42e6b6fda247 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-volume_attachments/370bab43-4912-47eb-8e3d-ac6e27615219" status: 202 len: 0 microversion: 2.1 time: 0.265598 Oct 24 13:48:05.935189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 374/756] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:48:05 2022] DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-volume_attachments/370bab43-4912-47eb-8e3d-ac6e27615219 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:48:06.087048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:06.087753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:06.094060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:06.094521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:06.094970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:06.095642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:06.096094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:06.096524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:06.241360 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:06.249474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-945bd12a-25fe-4f9a-af23-2c527612c204 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.166667 Oct 24 13:48:06.250222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 375/757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:06 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:06.254786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:06.255384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:06.260809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:06.261284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:06.261712 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:06.262410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:06.262858 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:06.263273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:06.392540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:06.401053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:06.402538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:06.403696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9316a62c-3ea5-4d3e-8bec-554425174d4d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.152437 Oct 24 13:48:06.404245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 376/758] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:06 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:07.272937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:07.273549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:07.279954 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:07.280424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:07.280855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:07.282601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:07.283052 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:07.283478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:07.421392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:07.429827 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7bba3865-cf0e-4c1f-9723-c10b0579f9a0 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.160727 Oct 24 13:48:07.430399 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 377/759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:07 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:07.434736 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:07.435331 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:07.441400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:07.441873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:07.442337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:07.443014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:07.443459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:07.443940 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:07.576090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:07.585460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:07.586926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:07.588078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-51f6fa4d-86b9-4890-b7e5-df5cb9485890 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.156785 Oct 24 13:48:07.588633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 378/760] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:07 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:07.989899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=5 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:08.065692 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=29 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:08.452832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:08.453631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:08.459990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:08.460459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:08.460887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:08.461568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:08.462011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:08.462454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:08.601680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:08.610958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-da3f7318-dd3d-4a4f-a2f8-14dd69e6c750 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.161784 Oct 24 13:48:08.611524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 379/761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:08 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:08.615892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:08.616484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:08.621956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:08.622469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:08.622900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:08.623573 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:08.624017 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:08.624430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:08.960009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:08.968594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:08.970866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:08.972066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-950bf54f-1e69-4b23-889b-3d0eb97f7b54 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.359636 Oct 24 13:48:08.972625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 380/762] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:08 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:09.635813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:09.636965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:09.658574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:09.659065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:09.659496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:09.660211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:09.660658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:09.661076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:09.802264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:09.810498 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3f88329a-023e-4a78-9009-5773335c4b25 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.179059 Oct 24 13:48:09.811055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 381/763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:09 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:09.996800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:09.997335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:10.003264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:10.003744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:10.004177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:10.004861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:10.005311 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:10.005730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:10.143341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:10.151815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:10.153243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:10.154426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d3fed62e-9aef-4743-b0fb-715162371439 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.161532 Oct 24 13:48:10.154977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 382/764] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:09 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:48:10.791806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-61a3d67e-9cf5-43c5-90e3-39ad079933d0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.934225 Oct 24 13:48:10.792902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 383/765] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:47:57 2022] POST /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments => generated 194 bytes in 12936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:10.837634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:10.840269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:10.849744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:10.850261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:10.850700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:10.851402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:10.851854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:10.852273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:11.006603 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:11.014752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-aca713a2-5a4a-4777-b247-7508e723b812 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1749 microversion: 2.1 time: 0.183861 Oct 24 13:48:11.015318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 383/766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:10 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:11.185343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:11.186072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:11.193908 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:11.194344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:11.195448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:11.196165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:11.196622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:11.197044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:11.389545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:11.399295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:11.400842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:11.402071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-94e1f2d7-8be4-41c2-9b2a-70c30588cd2b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.222781 Oct 24 13:48:11.402714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 384/767] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:11 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:12.039154 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:12.039801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:12.046373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.047426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.048058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.048767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.049393 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.049825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.193339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:12.201652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1999ace5-a937-440d-9f72-28b9dcad60ba tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.166490 Oct 24 13:48:12.202291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 384/768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:12 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:12.375601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bcb4f355-3edf-4b80-a32a-0448ce1b1941 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:12.383603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bcb4f355-3edf-4b80-a32a-0448ce1b1941 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.384081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bcb4f355-3edf-4b80-a32a-0448ce1b1941 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.384508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bcb4f355-3edf-4b80-a32a-0448ce1b1941 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.406604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bcb4f355-3edf-4b80-a32a-0448ce1b1941 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Going to try to stop instance {{(pid=125457) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 13:48:12.429055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:12.429780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:12.436771 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.438113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.438989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.439927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.440470 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.440971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.452313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bcb4f355-3edf-4b80-a32a-0448ce1b1941 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action" status: 202 len: 0 microversion: 2.1 time: 0.080516 Oct 24 13:48:12.453090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 385/769] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:48:12 2022] POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:48:12.463127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:12.463819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:12.471137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.471780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.472213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.472917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:12.473367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:12.473784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:12.596457 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:12.606770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:12.609014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:12.611407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-072fa0c1-13de-4e71-877c-69e8aa70820d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.186253 Oct 24 13:48:12.612170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 385/770] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:12 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:48:12.623164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:12.630994 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bf118b7f-65f5-4425-9358-20cc4a8ad528 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.173222 Oct 24 13:48:12.631552 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 386/771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:12 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:13.227018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:13.227672 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:13.234070 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:13.234593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:13.235027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:13.235722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:13.236174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:13.236597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:13.376449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:13.384607 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1f1f61ea-dd66-467b-9532-01877f1f6c14 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.161484 Oct 24 13:48:13.385167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 386/772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:13 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:13.637904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:13.638543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:13.645857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:13.646381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:13.646808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:13.647488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:13.647938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:13.648352 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:13.654500 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:13.655118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:13.661186 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:13.661664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:13.662098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:13.663521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:13.663978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:13.664402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:13.679975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:13.777901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:13.787255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:13.788698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:13.789862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-37c97f7d-9126-4687-afd8-b3c011ec79e6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.155879 Oct 24 13:48:13.790456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 387/773] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:13 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:13.800617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:13.808415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-27129003-d67c-4932-9782-61882ee4d6fe tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.157772 Oct 24 13:48:13.808979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 387/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:13 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:14.409532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:14.410134 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:14.415998 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:14.416463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:14.416891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:14.417596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:14.418042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:14.418509 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:14.559583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:14.567725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a74ac9c6-251a-4ae3-bc25-3980d65f615d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.162800 Oct 24 13:48:14.568285 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 388/775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:14 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:14.816415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:14.817010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:14.823414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:14.823889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:14.824316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:14.824992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:14.825437 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:14.825852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:14.832482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:14.833095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:14.840046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:14.840521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:14.840953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:14.841636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:14.842079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:14.842591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:14.956806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:14.965313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:14.966790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:14.967951 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-24a9bc4a-d088-4331-b426-93ef2c87d122 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.155913 Oct 24 13:48:14.968557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 388/776] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:14 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:14.981428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:14.989298 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b2f45d6f-d0be-4d38-b233-b0034e9fd951 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.160583 Oct 24 13:48:14.989864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 389/777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:14 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:15.591734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:15.592481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:15.599269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:15.599750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:15.600183 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:15.600871 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:15.601397 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:15.601818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:15.747265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:15.755359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-da7f2d43-7463-4dca-ab78-98401888ddbf tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.167612 Oct 24 13:48:15.755916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 389/778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:15 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:15.993438 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:15.993963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:16.000262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:16.000735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:16.001165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:16.001838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:16.002311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:16.002723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:16.012812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:16.013436 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:16.020800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:16.021285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:16.021726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:16.022464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:16.022926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:16.023353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:16.151392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:16.159912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:16.161416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:16.163505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:16.165531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-aa676a35-b5d8-43f7-a7ac-302c62704f26 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.176036 Oct 24 13:48:16.166734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 390/779] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:15 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:16.168655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-27141010-729e-4245-9e18-0b559768d258 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.159795 Oct 24 13:48:16.169385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 390/780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:16 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:16.779077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:16.779741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:16.785955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:16.786471 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:16.786904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:16.787586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:16.788038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:16.788457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:16.927137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:16.935225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c63e7d45-9084-46b9-9ddb-2cc86d37b28e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.159998 Oct 24 13:48:16.935790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 391/781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:16 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:17.191479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:17.192088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:17.192318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:17.193050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:17.200353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:17.200928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:17.201602 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:17.202518 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:17.203143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:17.203143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:17.204038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:17.204199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:17.204674 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:17.209870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:17.210539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:17.211126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:17.340286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:17.342297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:17.349566 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:17.350640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-13d1f574-a450-4e88-8414-ac9c83dce241 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.162315 Oct 24 13:48:17.351038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:17.351516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 392/782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:17 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:17.352206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b9c25d62-4dd5-48b3-9420-ffa802f44067 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.165857 Oct 24 13:48:17.352759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 391/783] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:17 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:17.959944 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:17.960581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:17.966511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:17.966985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:17.967415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:17.968096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:17.968651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:17.969355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:18.120590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:18.129308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-723d914e-070f-4b45-a5d4-9db975040593 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.173167 Oct 24 13:48:18.129872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 393/784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:17 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:18.374204 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:18.375329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:18.378205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:18.378436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:18.379142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:18.384442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:18.384920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:18.385150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:18.385364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:18.385624 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:18.386038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:18.386140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:18.386512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:18.386746 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:18.386931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:18.387190 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:18.387609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:18.522308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:18.529330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:18.534109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:18.535586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:18.536927 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2dd49459-6849-48a9-a1d2-85a794febec7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.162652 Oct 24 13:48:18.537494 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 394/785] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:18 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:48:18.550354 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e1ed6498-ea7e-4a63-a9bd-e0dad3897664 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.168242 Oct 24 13:48:18.550354 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 392/786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:18 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:19.153367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:19.153902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:19.160303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.160780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.161212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.161897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.162458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.162880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.302823 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:19.311179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7ae93f92-8f89-4cf6-8e1e-3734e507fde6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.161690 Oct 24 13:48:19.311755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 393/787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:19 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:19.418145 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:19.420558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:19.427668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.428146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.428580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.429302 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.429751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.430195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.452247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'flavor' on Instance uuid 9579f437-ab71-4398-b0b8-9a0a9248866d {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:48:19.564401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:19.565440 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:19.571906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.572747 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.573434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.574141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.574627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.575356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.580250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3e308b7c-54f8-4c97-a77b-558560dd8f2f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/action" status: 200 len: 32 microversion: 2.1 time: 0.166092 Oct 24 13:48:19.580861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 395/788] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:48:19 2022] POST /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:48:19.586390 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:19.587090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:19.594189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.594670 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.595103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.595883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.596346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.596880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.601345 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:19.751497 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:19.760185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:19.761621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:19.762805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-475fb1ea-565e-48c1-b7ad-72a9f8b33c4b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.180811 Oct 24 13:48:19.763368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 396/789] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:19 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:19.768326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:19.768898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:19.774925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.775403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.775835 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.776526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:19.776974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:19.777397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:19.830052 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:19.839079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4be1cde2-baf7-4808-981f-8efc4ab80dd5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.279164 Oct 24 13:48:19.840375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 394/790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:19 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:19.911122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:19.919392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-258ce442-9557-43da-ab70-759cec067dff tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.155059 Oct 24 13:48:19.920020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 397/791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:19 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:20.334396 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:20.335012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:20.340875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.341355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.341802 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.342512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.342962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.343880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.483922 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:20.492402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-82ec4385-6dd7-4f29-9db8-f1e64ea64f07 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.161912 Oct 24 13:48:20.492964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 395/792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:20 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:20.790453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:20.791089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:20.798312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.798792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.799229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.799910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.800356 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.800776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.868028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:20.868448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:20.874376 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.874952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.875435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.876071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.876523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.876949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.933242 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:20.942153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:20.943667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:20.944827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-36836443-b188-4b4b-b78e-b43ade67ebd4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.158330 Oct 24 13:48:20.945485 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 398/793] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:20 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:20.950033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:20.950668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:20.956514 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.956992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.957450 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:20.958138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:20.958694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:20.959115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:21.012935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:21.020903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8b9a077b-2184-458f-bee9-cc3cc3572f16 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.157054 Oct 24 13:48:21.021462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 396/794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:20 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:21.089317 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:21.097998 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ce2e3d54-cde6-4c2c-b0a6-834f27536a53 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.151526 Oct 24 13:48:21.098598 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 399/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:20 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:21.517407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:21.518104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:21.524157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:21.524643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:21.525078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:21.525772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:21.526250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:21.526674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:21.552429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-2fa9ec64-b4c0-4395-93d6-b517e41247c6 req-4917043b-c4bb-472a-bacd-aa7348f3b534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "name": "network-vif-plugged", "status": "completed", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:21.563200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-2fa9ec64-b4c0-4395-93d6-b517e41247c6 req-4917043b-c4bb-472a-bacd-aa7348f3b534 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:21.564635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-2fa9ec64-b4c0-4395-93d6-b517e41247c6 req-4917043b-c4bb-472a-bacd-aa7348f3b534 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:21.565066 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-2fa9ec64-b4c0-4395-93d6-b517e41247c6 req-4917043b-c4bb-472a-bacd-aa7348f3b534 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:21.577498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-2fa9ec64-b4c0-4395-93d6-b517e41247c6 req-4917043b-c4bb-472a-bacd-aa7348f3b534 service nova] Creating event network-vif-plugged:07c0c60c-b6e6-4992-af52-d3d7c785897b for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f on hv-cinder-86249 Oct 24 13:48:21.583515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-2fa9ec64-b4c0-4395-93d6-b517e41247c6 req-4917043b-c4bb-472a-bacd-aa7348f3b534 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Oct 24 13:48:21.584730 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 400/796] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:48:21.678899 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:21.687627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0f861d8a-8f15-42fb-8661-ce159ffb2416 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.174123 Oct 24 13:48:21.688453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 397/797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:21 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:21.972353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:21.972964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:21.979489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:21.979957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:21.980382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:21.981058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:21.981500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:21.981915 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.044949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:22.045622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:22.053150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:22.053647 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:22.054080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.054803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:22.055254 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:22.055676 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.116507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:22.127405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:22.128942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:22.130114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-03c595c8-a172-4ec6-8111-c9884d1c5ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.162737 Oct 24 13:48:22.130909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 401/798] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:21 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:48:22.135144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:22.135735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:22.142325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:22.142805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:22.143231 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.143918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:22.144462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:22.144773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.275220 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:22.285732 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:22.291228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-46e64403-47c5-45ea-8abd-b8bea2db7c41 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.250062 Oct 24 13:48:22.292227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 398/799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:22 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:22.299079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7387db8b-87f7-4a04-a717-9310371f03d2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.167254 Oct 24 13:48:22.299650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 402/800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:22 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:22.711895 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:22.712576 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:22.718551 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:22.719029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:22.719459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.720883 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:22.721369 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:22.721790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:22.861667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:22.869561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5b1ee84b-3f85-413a-bca8-bfa9a68491c6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1754 microversion: 2.1 time: 0.161479 Oct 24 13:48:22.870127 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 399/801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:22 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:23.157110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:23.157854 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:23.164381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.164866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.165301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.165988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.166470 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.166894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.294011 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:23.303096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:23.304541 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:23.305723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d72f52ef-69b5-42c2-b27d-81a2b71005db tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.152865 Oct 24 13:48:23.306361 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 403/802] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:23 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:23.316549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:23.317801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:23.322882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:23.323698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:23.325988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.326526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.327063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.327788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.328284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.328719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.331334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.331822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.332465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.333183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.333639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.334726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.475769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:23.476701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:23.483830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7bf1ad3c-ad5a-4056-b905-37f4a1f10fa6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.172086 Oct 24 13:48:23.484427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 400/803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:23 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:23.484892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-af9d2a92-f7c1-4b2c-b9ea-0019a742e9f6 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.165940 Oct 24 13:48:23.485970 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 404/804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:23 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:23.892633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:23.893298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:23.899253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.899733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.900164 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:23.900844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:23.901294 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:23.901714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.045900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:24.055610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-46295403-0137-4447-b40a-7fb1442ac950 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1757 microversion: 2.1 time: 0.166918 Oct 24 13:48:24.056180 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 401/805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:23 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:24.334113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:24.334722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:24.340716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:24.341197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:24.341635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.342381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:24.342838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:24.343267 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.488717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:24.505739 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:24.507532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:24.508396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-076e0306-1aa6-4fc9-b03d-2550b145649d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1809 microversion: 2.20 time: 0.179454 Oct 24 13:48:24.509144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 405/806] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:24 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:48:24.509286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:24.510234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:24.513562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:24.514192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:24.516538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:24.517594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:24.518149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.518919 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:24.519389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:24.520022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.521896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:24.522407 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:24.523210 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.524060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:24.526184 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:24.526740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:24.669566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:24.676476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:24.678328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2262849e-1d09-44fb-bcf6-2d1ee903e17c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.168363 Oct 24 13:48:24.679092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 406/807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:24 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:24.684643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-686d0017-c0a5-4d8d-9cf2-c9f487ee4de7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.179722 Oct 24 13:48:24.685196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 402/808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:24 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:25.538214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:25.538763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:25.545246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:25.545727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:25.546185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:25.546873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:25.547325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:25.547791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:25.706569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:25.707203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:25.713963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:25.714489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:25.714937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:25.715650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:25.716110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:25.716537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:25.850834 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:25.859138 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8c82107a-c13d-4b04-b8e2-99da414d1ff1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.159842 Oct 24 13:48:25.859707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 403/809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:25 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:25.864490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:25.865107 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:25.871093 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:25.871572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:25.872013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:25.872711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:25.873168 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:25.873599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:25.877568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:25.900932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:25.910853 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:25.912300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:25.913429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-55c638da-63b5-43f6-bbfb-9ede9e85b0f8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1796 microversion: 2.20 time: 0.379246 Oct 24 13:48:25.913985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 407/810] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:48:25 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1796 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:48:26.003675 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:26.011287 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fb8eab01-327b-4bbd-bdff-402d21e7f14a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.150493 Oct 24 13:48:26.011844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 404/811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:25 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:26.882328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:26.882938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:26.889210 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:26.889684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:26.890110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:26.890808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:26.891249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:26.891677 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:27.020418 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:27.028510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f764cb92-bb9d-4699-b3b1-eb6d6deea0bd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.150028 Oct 24 13:48:27.029074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 408/812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:26 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:27.035892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:27.036510 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:27.042999 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:27.043484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:27.043920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:27.044604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:27.045058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:27.045478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:27.177023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:27.184664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c061f39b-658d-4235-a179-60b2d44e366b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1679 microversion: 2.1 time: 0.153381 Oct 24 13:48:27.185223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 405/813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:27 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:28.052577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:28.053280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:28.059755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.060223 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.060650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.061326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.061771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.062203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.192157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:28.200308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-98606b87-ac35-411f-80eb-827c56217962 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.152089 Oct 24 13:48:28.200877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 409/814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:28 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:28.208640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:28.209247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:28.215835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.216323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.216735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.217441 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.217961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.218414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.347849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:28.355548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-27f8d01c-e780-4475-91d3-2ae83580ff8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1656 microversion: 2.1 time: 0.151198 Oct 24 13:48:28.356112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 406/815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:28 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:28.378751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4e1c20dd-93f4-4a5c-a477-9b914259bfa7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:28.384691 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4e1c20dd-93f4-4a5c-a477-9b914259bfa7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.385173 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4e1c20dd-93f4-4a5c-a477-9b914259bfa7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.385605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4e1c20dd-93f4-4a5c-a477-9b914259bfa7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.407664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4e1c20dd-93f4-4a5c-a477-9b914259bfa7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Going to try to start instance {{(pid=125457) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 13:48:28.449861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4e1c20dd-93f4-4a5c-a477-9b914259bfa7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action" status: 202 len: 0 microversion: 2.1 time: 0.074927 Oct 24 13:48:28.450496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 410/816] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:48:28 2022] POST /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:48:28.458788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:28.459400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:28.465192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.465670 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.466143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.466848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:28.467318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:28.467753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:28.685687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:28.693847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8e234fa3-4c21-44b6-b634-9cc95d96ed39 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1665 microversion: 2.1 time: 0.239136 Oct 24 13:48:28.694446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 407/817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:28 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:29.225242 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:29.225951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:29.232085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:29.232568 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:29.233010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:29.233705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:29.234179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:29.234603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:29.363988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:29.372097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9c9bbd15-bc47-4687-889e-b6c2c512d637 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.152109 Oct 24 13:48:29.372663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 411/818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:29 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:29.718532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:29.719151 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:29.726455 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:29.727385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:29.727385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:29.728059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:29.728509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:29.728930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:29.862620 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:29.870552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e397ebab-7129-4674-8900-4e428b13801c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1665 microversion: 2.1 time: 0.156373 Oct 24 13:48:29.871374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 408/819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:29 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:30.396930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:30.397553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:30.404099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:30.404581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:30.405020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:30.405708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:30.406185 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:30.406865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:30.425166 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:30.541234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:30.551479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5826bcb2-e0b4-4a44-8152-2778919262b1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.159168 Oct 24 13:48:30.552046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 412/820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:30 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:30.895266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:30.895888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:30.902373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:30.902854 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:30.903290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:30.903974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:30.904426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:30.904849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:31.036336 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:31.043853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1aaccc0b-9a59-4b58-a44d-b84c122a91a7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1669 microversion: 2.1 time: 0.153260 Oct 24 13:48:31.044415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 409/821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:30 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:31.575702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:31.576310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:31.583644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:31.584118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:31.584546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:31.585228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:31.585671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:31.586087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:31.711802 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:31.719847 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c756a11c-1184-43b6-8285-d8a5fa0ec30e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.148050 Oct 24 13:48:31.721033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 413/822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:31 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:32.743621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:32.744134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:32.750817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:32.751289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:32.751720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:32.752402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:32.752844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:32.753262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:32.880350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:32.888509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fe41f3a8-9808-47e7-b584-353f1edfbcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.148860 Oct 24 13:48:32.889068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 410/823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:32 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:33.912346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:33.912971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:33.919315 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:33.919788 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:33.920217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:33.920891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:33.921339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:33.921755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.055706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:34.065117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f38b4a1e-b936-47e7-9c87-75ed170ebde0 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1734 microversion: 2.1 time: 0.155981 Oct 24 13:48:34.065779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 414/824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:33 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:34.397550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:34.398057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:34.404161 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.404646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.405086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.405780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.406519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.406949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.431003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-601d26d6-1bbb-4bdc-acff-bd7e27235e7d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/ips" status: 200 len: 148 microversion: 2.1 time: 0.138204 Oct 24 13:48:34.431551 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 411/825] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:48:34 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/ips => generated 148 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:34.443529 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03dc6887-6062-4673-bd4f-3edfad4def3f"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:34.445978 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:34.452029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.452431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.452864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.453554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.454008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.454463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.535155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Invalid volume: volume 03dc6887-6062-4673-bd4f-3edfad4def3f is already attached to instances: dafd3f2b-d38e-4889-aa12-0c584189083a Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: POST /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/os-volume_attachments HTTP/1.1 Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 74 Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:48:34.536874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {"volumeAttachment": {"volumeId": "03dc6887-6062-4673-bd4f-3edfad4def3f"}} Oct 24 13:48:34.538498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Invalid volume: volume 03dc6887-6062-4673-bd4f-3edfad4def3f is already attached to instances: dafd3f2b-d38e-4889-aa12-0c584189083a Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'server_id': '91c938be-b9de-4df6-a185-4a2aab5f3be8', 'body': {'volumeAttachment': {'volumeId': '03dc6887-6062-4673-bd4f-3edfad4def3f'}}} Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03dc6887-6062-4673-bd4f-3edfad4def3f is already attached to instances: dafd3f2b-d38e-4889-aa12-0c584189083a Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:34.539456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03dc6887-6062-4673-bd4f-3edfad4def3f is already attached to instances: dafd3f2b-d38e-4889-aa12-0c584189083a Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:34.540882 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03dc6887-6062-4673-bd4f-3edfad4def3f is already attached to instances: dafd3f2b-d38e-4889-aa12-0c584189083a Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 400 to user: Invalid volume: volume 03dc6887-6062-4673-bd4f-3edfad4def3f is already attached to instances: dafd3f2b-d38e-4889-aa12-0c584189083a {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6533438f-47da-40a0-8b07-bf35ca664042 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099083 Oct 24 13:48:34.542464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 415/826] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:48:34 2022] POST /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:48:34.547079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:34.547629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:34.554412 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.554879 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.555313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.556004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.556484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.556893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.581839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:48:34.660918 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8c7944ad-168d-420a-a65c-e5967ec31538 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 204 len: 0 microversion: 2.1 time: 0.117386 Oct 24 13:48:34.661514 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 412/827] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:48:34 2022] DELETE /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:48:34.669756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:34.670405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:34.677065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.677546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.677979 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.678752 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:34.679258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:34.679712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:34.805520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:34.813124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0769b554-1e11-46f3-8639-c29de010b025 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1679 microversion: 2.1 time: 0.147196 Oct 24 13:48:34.813676 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 416/828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:34 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:35.089802 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:35.090530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:35.096579 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.097054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.097492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.098231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.098637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.099053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.230242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:35.238425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-02d327ba-3b23-4580-a142-c3f4d96384a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1714 microversion: 2.1 time: 0.153354 Oct 24 13:48:35.238977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 413/829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:35 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:35.300529 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:35.301025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:35.307370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.307852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.308282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.308967 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.309418 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.309840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.394934 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] HTTP exception thrown: Cannot 'detach_volume' instance 9579f437-ab71-4398-b0b8-9a0a9248866d while it is in vm_state rescued Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Request method failure captured: Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments/28f3c23f-aa6c-4494-b15a-cef9d0817c49 HTTP/1.1 Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYl-x2neo4NXAIMLiiF9DTr-DP3y40yUhgrDrnFH2vFUnkTTlsAjKaI46l-ToNo3WyNwj6m5yP_n7vsCfbyZtCTjs_PcHsDMqneWC3_8loL2hTnm65wLu4OYcTjb5_dlJLSvwvclAwu-B74UgwOIURmD-KGH19licV12odqlimpApw Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:48:35.396462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: be793f4685f94beba74adedbc02ee50a Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:48:35.398040 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Cannot 'detach_volume' instance 9579f437-ab71-4398-b0b8-9a0a9248866d while it is in vm_state rescued Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'server_id': '9579f437-ab71-4398-b0b8-9a0a9248866d', 'id': '28f3c23f-aa6c-4494-b15a-cef9d0817c49'} Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:48:35.398910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9579f437-ab71-4398-b0b8-9a0a9248866d while it is in vm_state rescued Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9579f437-ab71-4398-b0b8-9a0a9248866d while it is in vm_state rescued Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:35.400571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Returning 409 to user: Cannot 'detach_volume' instance 9579f437-ab71-4398-b0b8-9a0a9248866d while it is in vm_state rescued {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:48:35.402022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d1a2980e-5424-491b-a9a2-b70d53d350d8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments/28f3c23f-aa6c-4494-b15a-cef9d0817c49" status: 409 len: 152 microversion: 2.1 time: 0.101763 Oct 24 13:48:35.402022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 417/830] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:48:35 2022] DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments/28f3c23f-aa6c-4494-b15a-cef9d0817c49 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:48:35.407156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:35.407715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:35.414251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.414739 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.415176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.415860 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.416309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.416734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.481043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-431ff957-3134-473d-ab0d-486a06576707 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "POST /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/action" status: 202 len: 0 microversion: 2.1 time: 0.077759 Oct 24 13:48:35.481708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 414/831] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:48:35 2022] POST /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:48:35.490649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:35.491321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:35.497113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.497595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.498025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.498743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.499200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.499626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.625287 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:35.634238 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a169e0ec-8c99-43ac-8d51-485947917d9d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1722 microversion: 2.1 time: 0.148083 Oct 24 13:48:35.634801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 418/832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:35 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:35.837094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:35.837789 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:35.843936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.844416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.844846 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.845529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:35.846851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:35.847291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:35.975744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:35.983329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-71cd02db-b012-4a02-a4e8-591d6c7cdcb8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1679 microversion: 2.1 time: 0.150595 Oct 24 13:48:35.983885 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 415/833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:35 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:36.658645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:36.659368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:36.665762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:36.666452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:36.666896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:36.667583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:36.668037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:36.668455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:36.803608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:36.811763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-814035d3-d963-4194-b134-2990bba36fa1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1722 microversion: 2.1 time: 0.157372 Oct 24 13:48:36.812326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 419/834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:36 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:37.007514 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:37.008292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:37.014672 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:37.015151 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:37.015580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:37.016266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:37.016717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:37.017135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:37.289559 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:37.297296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8f72ab80-2513-4531-867d-3f0f9972d7e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1679 microversion: 2.1 time: 0.293625 Oct 24 13:48:37.297947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 416/835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:37 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1679 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:37.786814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-aa7e5e21-e95b-4ba8-9c05-7f0c5c331abe req-024e41c6-c2b8-4239-9b27-3516859a611c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91c938be-b9de-4df6-a185-4a2aab5f3be8", "name": "network-vif-deleted", "tag": "ac820142-a7d5-46c3-84b5-fea1b233b86e"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:37.796351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-aa7e5e21-e95b-4ba8-9c05-7f0c5c331abe req-024e41c6-c2b8-4239-9b27-3516859a611c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:37.796836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-aa7e5e21-e95b-4ba8-9c05-7f0c5c331abe req-024e41c6-c2b8-4239-9b27-3516859a611c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:37.797268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-aa7e5e21-e95b-4ba8-9c05-7f0c5c331abe req-024e41c6-c2b8-4239-9b27-3516859a611c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:37.809211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-aa7e5e21-e95b-4ba8-9c05-7f0c5c331abe req-024e41c6-c2b8-4239-9b27-3516859a611c service nova] Creating event network-vif-deleted:ac820142-a7d5-46c3-84b5-fea1b233b86e for instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 on hv-cinder-86249 Oct 24 13:48:37.814400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-aa7e5e21-e95b-4ba8-9c05-7f0c5c331abe req-024e41c6-c2b8-4239-9b27-3516859a611c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085976 Oct 24 13:48:37.815606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 420/836] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:37.835362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:37.835985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:37.842223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:37.842714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:37.843157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:37.843863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:37.844317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:37.844745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:37.975812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:37.984877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d051ca09-6269-48fc-b145-956097e3c372 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1722 microversion: 2.1 time: 0.153373 Oct 24 13:48:37.985452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 417/837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:37 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:38.321515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:38.322924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:38.324919 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=75 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:38.330819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:38.331306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:38.331737 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:38.332437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:38.332888 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:38.333309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:38.397473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:38.405389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-05b31d04-5e8e-464a-9840-4a20008bf3b9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1612 microversion: 2.1 time: 0.088190 Oct 24 13:48:38.406521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 421/838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:38 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:39.009192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:39.009805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:39.016263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:39.016749 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:39.017187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:39.018594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:39.019054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:39.019483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:39.034569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:39.175077 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:39.183456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-24ec0768-a0ca-458e-bf40-7318bce4ebfe tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1722 microversion: 2.1 time: 0.178203 Oct 24 13:48:39.184019 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 418/839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:39 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:39.429754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:39.430491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:39.437145 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:39.437629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:39.438155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:39.445469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:39.453081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:39.453638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:39.494325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:39.495128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:39.495632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:39.496024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lazy-loading 'fault' on Instance uuid 91c938be-b9de-4df6-a185-4a2aab5f3be8 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:48:39.538992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:39.547189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-59894748-5a56-4edc-b1ae-82ead21701bf tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 200 len: 1331 microversion: 2.1 time: 0.121416 Oct 24 13:48:39.547875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 422/840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:39 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:40.211723 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:40.212743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:40.219670 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:40.220093 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:40.220685 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:40.222010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:40.222389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:40.222816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:40.353478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:40.362324 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6da0c838-6114-460d-9178-4a488d086abd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1728 microversion: 2.1 time: 0.158166 Oct 24 13:48:40.362891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 419/841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:40 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:40.385842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:40.386510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:40.393097 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:40.393588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:40.394022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:40.394748 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:40.395198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:40.395620 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:40.476810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cd18f229-ef5c-4d83-8a7b-855481a4a44d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094965 Oct 24 13:48:40.477661 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 423/842] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:48:40 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:48:40.570956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:40.571571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:40.577427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:40.577910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:40.578400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:40.579096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:40.579594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:40.580543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:40.594591 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 HTTP/1.1 Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:48:40.596908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:48:40.599619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '91c938be-b9de-4df6-a185-4a2aab5f3be8'} Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:48:40.601104 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:48:40.603284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:48:40.605159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:48:40.605159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-77cd433e-6408-44dd-ac19-91e9f47dc7be tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 404 len: 111 microversion: 2.1 time: 0.031222 Oct 24 13:48:40.605159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 420/843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:40 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:48:40.612046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b6f83862-eced-4397-a82c-d3cf7c43a53a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '.version_select at 0x7f8dc2808280>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:40.632860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b6f83862-eced-4397-a82c-d3cf7c43a53a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345662504" status: 202 len: 0 microversion: 2.1 time: 0.024984 Oct 24 13:48:40.633427 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 424/844] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 24 13:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345662504 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:48:41.319120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:41.319650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:41.326011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:41.326516 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:41.326947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:41.327631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:41.328075 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:41.328491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:41.432044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lazy-loading 'services' on Instance uuid dafd3f2b-d38e-4889-aa12-0c584189083a {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:48:41.474617 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-da40d22b-5f99-43a8-a597-8186c446c42f req-d4a35f9e-9a00-4785-b269-7a2342de3efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9579f437-ab71-4398-b0b8-9a0a9248866d", "tag": "194721dc-2119-43f8-b40f-44906812d57a"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:41.486019 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da40d22b-5f99-43a8-a597-8186c446c42f req-d4a35f9e-9a00-4785-b269-7a2342de3efb service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:41.487500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da40d22b-5f99-43a8-a597-8186c446c42f req-d4a35f9e-9a00-4785-b269-7a2342de3efb service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:41.488017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-da40d22b-5f99-43a8-a597-8186c446c42f req-d4a35f9e-9a00-4785-b269-7a2342de3efb service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:41.500563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-da40d22b-5f99-43a8-a597-8186c446c42f req-d4a35f9e-9a00-4785-b269-7a2342de3efb service nova] Creating event network-changed:194721dc-2119-43f8-b40f-44906812d57a for instance 9579f437-ab71-4398-b0b8-9a0a9248866d on hv-cinder-86249 Oct 24 13:48:41.506806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-da40d22b-5f99-43a8-a597-8186c446c42f req-d4a35f9e-9a00-4785-b269-7a2342de3efb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103643 Oct 24 13:48:41.508272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 425/845] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:41.515811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e694b0da-d5e4-4d7b-8367-1ade4500f12a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments/03dc6887-6062-4673-bd4f-3edfad4def3f" status: 202 len: 0 microversion: 2.1 time: 0.200809 Oct 24 13:48:41.516380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 421/846] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:48:41 2022] DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments/03dc6887-6062-4673-bd4f-3edfad4def3f => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:48:41.536760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:41.539086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:41.548443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:41.549212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:41.550584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:41.551500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:41.552212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:41.552826 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:41.602006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0471ca53-7094-44a3-8be8-aa307c42ff15 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079275 Oct 24 13:48:41.606332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 426/847] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:48:41 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:48:42.617663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:42.620489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:42.628334 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:42.628817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:42.629248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:42.629948 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:42.630421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:42.630842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:42.664810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-50eb9e5a-779b-41b8-88bb-435636979a28 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053659 Oct 24 13:48:42.665385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 422/848] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:48:42 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:48:42.728849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:42.729368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:42.735625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:42.736106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:42.737204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:42.737908 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:42.738392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:42.738818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:42.763232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:48:42.836224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1eac0643-842e-41ba-8ddc-4fa7dc77a005 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 204 len: 0 microversion: 2.1 time: 0.110888 Oct 24 13:48:42.836840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 427/849] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:48:42 2022] DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:48:42.844970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:42.846152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:42.852247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:42.852721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:42.853152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:42.853837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:42.854312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:42.854731 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:42.982624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:42.990544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dc3f5aa6-4d87-4b32-a79c-43780906b0e3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1678 microversion: 2.1 time: 0.149422 Oct 24 13:48:42.991111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 423/850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:42 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:43.524086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-d5f002b8-269d-4190-9867-b16482206580 req-e74203ac-1921-499b-a99a-f603d0f1694a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9579f437-ab71-4398-b0b8-9a0a9248866d", "tag": "194721dc-2119-43f8-b40f-44906812d57a"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:43.536326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-d5f002b8-269d-4190-9867-b16482206580 req-e74203ac-1921-499b-a99a-f603d0f1694a service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:43.536797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-d5f002b8-269d-4190-9867-b16482206580 req-e74203ac-1921-499b-a99a-f603d0f1694a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:43.537229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-d5f002b8-269d-4190-9867-b16482206580 req-e74203ac-1921-499b-a99a-f603d0f1694a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:43.549248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-d5f002b8-269d-4190-9867-b16482206580 req-e74203ac-1921-499b-a99a-f603d0f1694a service nova] Creating event network-changed:194721dc-2119-43f8-b40f-44906812d57a for instance 9579f437-ab71-4398-b0b8-9a0a9248866d on hv-cinder-86249 Oct 24 13:48:43.554465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-d5f002b8-269d-4190-9867-b16482206580 req-e74203ac-1921-499b-a99a-f603d0f1694a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035705 Oct 24 13:48:43.555046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 428/851] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:44.013406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:44.015190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:44.024090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:44.024580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:44.025012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:44.025712 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:44.026180 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:44.026604 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:44.371267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:44.379945 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-88e93e76-0648-4fea-9c51-2f02ffb5e367 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1678 microversion: 2.1 time: 0.370745 Oct 24 13:48:44.380519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 424/852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:44 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:45.116541 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-634d716d-2100-4d3c-871d-f91b86522829 req-c8acb395-1abe-457d-bd13-f97ece4a745c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafd3f2b-d38e-4889-aa12-0c584189083a", "name": "network-vif-deleted", "tag": "3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:45.137662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-634d716d-2100-4d3c-871d-f91b86522829 req-c8acb395-1abe-457d-bd13-f97ece4a745c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:45.138568 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-634d716d-2100-4d3c-871d-f91b86522829 req-c8acb395-1abe-457d-bd13-f97ece4a745c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:45.139026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-634d716d-2100-4d3c-871d-f91b86522829 req-c8acb395-1abe-457d-bd13-f97ece4a745c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:45.153360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-634d716d-2100-4d3c-871d-f91b86522829 req-c8acb395-1abe-457d-bd13-f97ece4a745c service nova] Creating event network-vif-deleted:3ec0aeaf-4107-4f67-8a8d-2fc8a220f1c4 for instance dafd3f2b-d38e-4889-aa12-0c584189083a on hv-cinder-86249 Oct 24 13:48:45.158772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-634d716d-2100-4d3c-871d-f91b86522829 req-c8acb395-1abe-457d-bd13-f97ece4a745c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046502 Oct 24 13:48:45.159697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 429/853] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:45.404372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:45.405133 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:45.412734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:45.413242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:45.413657 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:45.414389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:45.414845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:45.415421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:45.449157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:45.449877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:45.450355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:45.450818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lazy-loading 'fault' on Instance uuid dafd3f2b-d38e-4889-aa12-0c584189083a {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:48:45.498548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:45.506317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ceec9c91-285a-4e0a-9a85-a8c51eb02dc8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 200 len: 1331 microversion: 2.1 time: 0.105638 Oct 24 13:48:45.506892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 425/854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:45 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:46.529813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:46.530447 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:46.537228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:46.537705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:46.538137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:46.538848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:46.539303 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:46.539725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:46.552570 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a HTTP/1.1 Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:48:46.554220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:48:46.555780 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'dafd3f2b-d38e-4889-aa12-0c584189083a'} Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:48:46.556817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:48:46.558306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:48:46.559684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:48:46.559684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1a016b0d-395b-4565-a7bd-a8dc660a6df3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 404 len: 111 microversion: 2.1 time: 0.030043 Oct 24 13:48:46.559684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 430/855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:46 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:48:46.564873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bb895eb9-2701-4626-ba4e-c531c10f4691 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '.version_select at 0x7f8dc6126040>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:46.587935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bb895eb9-2701-4626-ba4e-c531c10f4691 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341082593" status: 202 len: 0 microversion: 2.1 time: 0.027333 Oct 24 13:48:46.588523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 426/856] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 24 13:48:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341082593 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:48:47.216229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-35bca6c5-256b-4198-859c-e68a034f60dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: .version_select at 0x7f8dc2807dc0>, body: {"keypair": {"name": "tempest-keypair-754411184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLebSy4YswzqeHAI/Et4QF7nievJuSR9wlHovVQ1nbGNlfCuBo4qBp55nGgx+F4E1LPUD+BwV1QvJ0b98AZWUu9ASqvrW5V26ymNtzjayd7Xb0pSGtSng5rlQdCuK1UWaA=="}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:47.232203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-35bca6c5-256b-4198-859c-e68a034f60dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:48:47.235993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-35bca6c5-256b-4198-859c-e68a034f60dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:48:47.258371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-35bca6c5-256b-4198-859c-e68a034f60dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045965 Oct 24 13:48:47.258993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 431/857] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:48:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:48.464964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-597353099", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "051d9444-c9f6-450e-99dd-61dcbd128cbe"}], "security_groups": [{"name": "tempest-securitygroup--369773385"}], "key_name": "tempest-keypair-754411184", "user_data": "}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:48.474523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:48.570991 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] validate_networks() for [('051d9444-c9f6-450e-99dd-61dcbd128cbe', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:48:48.941852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:48:48.942304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:48:48.942788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:48:48.943198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:48:48.943608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:48:48.952682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:48.953169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:48.953597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:48.954368 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:48.954826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:48.955251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:48.975427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:48:48.979338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:48:48.990190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:48:48.992460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:48:49.039060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9306ac7c-e8da-41e9-b181-0d682d00b184 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578942 Oct 24 13:48:49.039698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 427/858] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:48:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:48:49.051243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ec6df505-3fbe-4b54-89cc-96f2368cc15e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:49.051861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ec6df505-3fbe-4b54-89cc-96f2368cc15e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:49.118476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ec6df505-3fbe-4b54-89cc-96f2368cc15e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:49.125377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ec6df505-3fbe-4b54-89cc-96f2368cc15e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1240 microversion: 2.1 time: 0.078420 Oct 24 13:48:49.126142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 432/859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:49 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:50.148965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:50.149613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:50.155729 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:50.156465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:50.156902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:50.157593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:50.158138 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:50.158594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:50.230381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:50.239961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5cf6e38c-2fa6-42d6-841e-6eba5918094b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1292 microversion: 2.1 time: 0.095514 Oct 24 13:48:50.240961 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 428/860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:50 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:48:51.263539 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:51.264109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:51.271564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:51.272049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:51.272545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:51.273481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:51.273909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:51.274365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:51.406380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:51.410874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:51.416404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-71353ee3-0de5-4fa2-8ebe-7504d7494ba5 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.156801 Oct 24 13:48:51.417009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 433/861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:51 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:51.733716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-25ebab5d-9c35-4b41-a2cf-269dae2f9f58 req-3aee239c-6990-4e1e-b567-33d6853be545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5243fe8f-bbe8-4a2f-a52c-f013aba97508", "tag": "700cb08c-be6b-43d8-9142-b1364a7108cd"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:51.745431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-25ebab5d-9c35-4b41-a2cf-269dae2f9f58 req-3aee239c-6990-4e1e-b567-33d6853be545 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:51.746002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-25ebab5d-9c35-4b41-a2cf-269dae2f9f58 req-3aee239c-6990-4e1e-b567-33d6853be545 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:51.746557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-25ebab5d-9c35-4b41-a2cf-269dae2f9f58 req-3aee239c-6990-4e1e-b567-33d6853be545 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:51.759032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-25ebab5d-9c35-4b41-a2cf-269dae2f9f58 req-3aee239c-6990-4e1e-b567-33d6853be545 service nova] Creating event network-changed:700cb08c-be6b-43d8-9142-b1364a7108cd for instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 on hv-cinder-86249 Oct 24 13:48:51.764078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-25ebab5d-9c35-4b41-a2cf-269dae2f9f58 req-3aee239c-6990-4e1e-b567-33d6853be545 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 Oct 24 13:48:51.765019 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 429/862] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:52.441382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:52.441869 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:52.449323 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:52.449793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:52.450250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:52.450933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:52.451372 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:52.451790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:52.582281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:52.589809 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-42cb5f7b-9e11-4de3-bdd5-c4919053c967 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.153970 Oct 24 13:48:52.590400 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 434/863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:52 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:53.614046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:53.614794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:53.621384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:53.621858 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:53.622312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:53.622991 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:53.623435 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:53.623848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:53.754578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:53.762023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78c4ce88-22f9-4812-bee0-6f42a3e391ce tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.152689 Oct 24 13:48:53.762618 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 430/864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:53 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:54.784956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:54.785598 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:54.791640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:54.792122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:54.792794 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:54.793249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:54.793703 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:54.794129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:54.927408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:54.935044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8f9c231b-1ed7-462c-96a6-cd95a4329b16 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.154474 Oct 24 13:48:54.935606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 435/865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:54 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:55.959292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:55.959907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:55.966410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:55.966888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:55.967321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:55.968025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:55.968471 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:55.968888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:56.101148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:56.108840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a010f39b-2c99-4ea8-8a67-30bda674d9c9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.154295 Oct 24 13:48:56.109323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 431/866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:55 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:57.130897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:57.131507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:57.137995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:57.138439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:57.138867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:57.139555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:57.140009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:57.140431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:57.278357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:57.287558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cf90c8f2-480c-4eb5-ad38-7d27d8b4ae1c tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.160631 Oct 24 13:48:57.288189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 436/867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:57 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:57.845542 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-d9314387-3113-46ad-96fa-47031e3d3417 req-a7b94a29-650e-4c70-9a5d-30cddd132ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5243fe8f-bbe8-4a2f-a52c-f013aba97508", "name": "network-vif-plugged", "status": "completed", "tag": "700cb08c-be6b-43d8-9142-b1364a7108cd"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:48:57.857126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d9314387-3113-46ad-96fa-47031e3d3417 req-a7b94a29-650e-4c70-9a5d-30cddd132ca7 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:57.857611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d9314387-3113-46ad-96fa-47031e3d3417 req-a7b94a29-650e-4c70-9a5d-30cddd132ca7 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:57.858045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d9314387-3113-46ad-96fa-47031e3d3417 req-a7b94a29-650e-4c70-9a5d-30cddd132ca7 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:57.870027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-d9314387-3113-46ad-96fa-47031e3d3417 req-a7b94a29-650e-4c70-9a5d-30cddd132ca7 service nova] Creating event network-vif-plugged:700cb08c-be6b-43d8-9142-b1364a7108cd for instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 on hv-cinder-86249 Oct 24 13:48:57.875029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-d9314387-3113-46ad-96fa-47031e3d3417 req-a7b94a29-650e-4c70-9a5d-30cddd132ca7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 Oct 24 13:48:57.875680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 432/868] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:48:58.310870 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:58.311475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:58.317920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:58.318416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:58.318843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:58.319519 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:58.319967 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:58.320382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:58.447260 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:58.454884 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-64cddad7-6616-4acd-84ad-b33af442445f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.147842 Oct 24 13:48:58.455434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 437/869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:58 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:48:59.475042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:59.475727 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:48:59.480869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:48:59.481577 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:48:59.489179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:59.489656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:59.490091 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:59.490804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:48:59.491262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:48:59.491692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:48:59.623967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:48:59.632516 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9cb3f9f3-6870-4bb4-b99c-2712b24a74e1 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1365 microversion: 2.1 time: 0.158981 Oct 24 13:48:59.633085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 433/870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:48:59 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:00.655240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:00.655851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:00.657909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:00.663806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:00.664277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:00.664703 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:00.665380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:00.665822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:00.666266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:00.793209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:00.801311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-19178b48-9b29-4564-bf74-ad24c49d8fd8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1554 microversion: 2.1 time: 0.149854 Oct 24 13:49:00.801866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 438/871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:00 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:00.823661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:00.824172 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:00.830550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:00.831027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:00.831466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:00.832158 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:00.832613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:00.833034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:00.910871 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c09b2fc0-04a4-4fee-ba49-a8d0ca381d12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090997 Oct 24 13:49:00.911489 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 434/872] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:49:00 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:01.829231 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-17cc47ac-27c0-4dc7-8d45-4903599fdaeb req-c27ee843-aceb-4425-93bb-87d3a5742f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5243fe8f-bbe8-4a2f-a52c-f013aba97508", "tag": "700cb08c-be6b-43d8-9142-b1364a7108cd"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:01.839298 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-17cc47ac-27c0-4dc7-8d45-4903599fdaeb req-c27ee843-aceb-4425-93bb-87d3a5742f38 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:01.839772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-17cc47ac-27c0-4dc7-8d45-4903599fdaeb req-c27ee843-aceb-4425-93bb-87d3a5742f38 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:01.840196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-17cc47ac-27c0-4dc7-8d45-4903599fdaeb req-c27ee843-aceb-4425-93bb-87d3a5742f38 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:01.851230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-17cc47ac-27c0-4dc7-8d45-4903599fdaeb req-c27ee843-aceb-4425-93bb-87d3a5742f38 service nova] Creating event network-changed:700cb08c-be6b-43d8-9142-b1364a7108cd for instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 on hv-cinder-86249 Oct 24 13:49:01.856371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-17cc47ac-27c0-4dc7-8d45-4903599fdaeb req-c27ee843-aceb-4425-93bb-87d3a5742f38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030708 Oct 24 13:49:01.858595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 439/873] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:33.100827 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:33.101563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:33.119596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:33.120785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=32 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:33.211901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:33.212408 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:33.218561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.219045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.219478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.220171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.220623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.221047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.229177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1857243768"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:33.229816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:33.235993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.236479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.236916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.237641 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.238101 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.238575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.253363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-915cc5dd-7189-4d52-8edd-ea688a2146a4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments/491ee443-3dc7-446f-a259-1b97d0734b5d" status: 200 len: 194 microversion: 2.20 time: 0.154291 Oct 24 13:49:33.254552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 435/874] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Oct 24 13:49:33 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments/491ee443-3dc7-446f-a259-1b97d0734b5d => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:49:33.325481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:33.326055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:33.332199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.332946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.333458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.334159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.334637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.335054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.370496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.network.security_group_api [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Removing security group 66773652-b4a4-467f-ae43-3029fc2e7420 from port 7b7a8dbf-45be-45cc-bd21-3d784915e6d5 Oct 24 13:49:33.416512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lazy-loading 'services' on Instance uuid 586f4ffe-7aa6-4602-a4bd-48b62c92198f {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:33.488911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cfd95ea7-4d90-488a-8b2b-68d767310ed6 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments/491ee443-3dc7-446f-a259-1b97d0734b5d" status: 202 len: 0 microversion: 2.20 time: 0.166672 Oct 24 13:49:33.489825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 436/875] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 24 13:49:33 2022] DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments/491ee443-3dc7-446f-a259-1b97d0734b5d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:49:33.498706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:33.501089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:33.508365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.508933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.509432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.510480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.511112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.511619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.543812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-085f35fb-54c6-4211-a964-3241ec9f8142 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049505 Oct 24 13:49:33.544574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 437/876] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 24 13:49:33 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:49:33.690476 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7158e4f4-e83d-4a9f-a8ee-6889a60a0718 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.572181 Oct 24 13:49:33.691121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 440/877] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:49:33 2022] POST /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:49:33.696932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-4ebab642-0c6f-4e6c-83ec-338e15c31c4c req-e8330b7b-5c66-4a39-9543-62fd900281a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:33.706868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-4ebab642-0c6f-4e6c-83ec-338e15c31c4c req-e8330b7b-5c66-4a39-9543-62fd900281a8 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:33.707696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-4ebab642-0c6f-4e6c-83ec-338e15c31c4c req-e8330b7b-5c66-4a39-9543-62fd900281a8 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:33.708451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-4ebab642-0c6f-4e6c-83ec-338e15c31c4c req-e8330b7b-5c66-4a39-9543-62fd900281a8 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:33.721733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-4ebab642-0c6f-4e6c-83ec-338e15c31c4c req-e8330b7b-5c66-4a39-9543-62fd900281a8 service nova] Creating event network-changed:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:49:33.727148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-4ebab642-0c6f-4e6c-83ec-338e15c31c4c req-e8330b7b-5c66-4a39-9543-62fd900281a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035372 Oct 24 13:49:33.728938 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 438/878] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:49:34.557982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:34.560272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:34.567056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:34.567804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:34.568237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:34.569812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:34.570504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:34.570935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:34.616171 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4b05725c-0195-4bf3-8251-96bd8b0dba86 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062774 Oct 24 13:49:34.617066 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 441/879] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 24 13:49:34 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:34.685476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:34.686062 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:34.693103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:34.693579 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:34.694008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:34.694725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:34.695172 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:34.695594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:34.721258 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:49:34.797123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f555cf15-e6b1-4f8b-97e9-d2f32a35bb8f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 204 len: 0 microversion: 2.20 time: 0.115956 Oct 24 13:49:34.801699 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 439/880] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 24 13:49:34 2022] DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:49:34.808104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:34.809075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:34.815128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:34.815672 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:34.816276 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:34.817108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:34.817647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:34.818150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:35.011141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:35.011725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:35.018069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:35.018588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:35.019014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:35.020713 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:35.021317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:35.021737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:35.106966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:35.112451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lazy-loading 'services' on Instance uuid 946bcf67-fae7-4721-bf74-302318834a6b {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:35.115795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:35.117447 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:35.118836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cd97e388-3559-4670-962c-b1caa4cc8215 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.316021 Oct 24 13:49:35.119562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 442/881] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:34 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:49:35.188150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-796dd9a6-ef2f-49b2-aaee-1580d9a493c2 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments/6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b" status: 202 len: 0 microversion: 2.1 time: 0.181515 Oct 24 13:49:35.188766 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 440/882] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:49:35 2022] DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments/6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:49:35.197633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:35.199966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:35.206660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:35.207719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:35.208158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:35.208861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:35.209459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:35.209888 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:35.239650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3a6057bb-7960-4e16-a1b6-c253dd8d527f tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Oct 24 13:49:35.240199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 443/883] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:49:35 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:35.743660 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-9c4d428c-8636-4b0d-a516-3d1c2f19b003 req-b58f29d2-d8a5-46b1-8976-7735d8a179fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:35.753562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9c4d428c-8636-4b0d-a516-3d1c2f19b003 req-b58f29d2-d8a5-46b1-8976-7735d8a179fe service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:35.754855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9c4d428c-8636-4b0d-a516-3d1c2f19b003 req-b58f29d2-d8a5-46b1-8976-7735d8a179fe service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:35.755293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9c4d428c-8636-4b0d-a516-3d1c2f19b003 req-b58f29d2-d8a5-46b1-8976-7735d8a179fe service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:35.766856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-9c4d428c-8636-4b0d-a516-3d1c2f19b003 req-b58f29d2-d8a5-46b1-8976-7735d8a179fe service nova] Creating event network-changed:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:49:35.772162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-9c4d428c-8636-4b0d-a516-3d1c2f19b003 req-b58f29d2-d8a5-46b1-8976-7735d8a179fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032789 Oct 24 13:49:35.772777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 441/884] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:36.145175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:36.145801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:36.153060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:36.153546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:36.154006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:36.154791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:36.155441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:36.156249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:36.252281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:36.255231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:36.261554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:36.262034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:36.262496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:36.263191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:36.263643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:36.264064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:36.292575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:36.296101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-80110879-dea7-4ab9-ae66-00d3ce653d0d tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Oct 24 13:49:36.296667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 442/885] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:49:36 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:49:36.301048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:36.302509 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:36.303661 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-08588f8e-e76f-4309-a9ca-c0df5cb769fb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.162643 Oct 24 13:49:36.304198 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 444/886] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:36 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:37.308711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:37.311109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:37.318051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:37.318571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:37.319014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:37.319717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:37.320168 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:37.321741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:37.328829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:37.329576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:37.336980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:37.337183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:37.337585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:37.338304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:37.338774 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:37.339343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:37.353274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6333f3b0-6758-450f-a162-bd65b8786ee6 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048471 Oct 24 13:49:37.354054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 443/887] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:49:37 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:49:37.365070 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:37.365568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:37.371738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:37.372234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:37.372671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:37.373381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:37.373830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:37.374283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:37.458406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] HTTP exception thrown: Instance 946bcf67-fae7-4721-bf74-302318834a6b is not attached to volume 6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Request method failure captured: Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments/6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b HTTP/1.1 Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpa4ftIAtqwRUZszU_qZCADb9NsHN_2ruZ49GXxjbNA1yEeoh19be1HoBgPwbIODafZJjla_AA6PKHnz28Y1-73396X2U24Z4l7mwdOkqIFKgJlZ5AdwYRqsz62s3Rw5yY7Mm8xGVE59lLPOslMGhuoKEGuM8AKDJFAL64II2YkpiLI Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 5243c296c8cb4467bfd269e4622e1adb Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-TestMinimumBasicScenario-1833458857 Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:49:37.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-TestMinimumBasicScenario-1833458857 Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 5243c296c8cb4467bfd269e4622e1adb Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1833458857 Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-TestMinimumBasicScenario-1833458857-project Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 6e926bb8de284795bb6ebbda2dccc266 Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-TestMinimumBasicScenario-1833458857-project Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:49:37.469013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 946bcf67-fae7-4721-bf74-302318834a6b is not attached to volume 6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'server_id': '946bcf67-fae7-4721-bf74-302318834a6b', 'id': '6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b'} Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b. Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:49:37.469989 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946bcf67-fae7-4721-bf74-302318834a6b is not attached to volume 6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946bcf67-fae7-4721-bf74-302318834a6b is not attached to volume 6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:37.471571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Returning 404 to user: Instance 946bcf67-fae7-4721-bf74-302318834a6b is not attached to volume 6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:49:37.473425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cf7e7d00-59c0-4441-af59-5fa56041cc0e tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments/6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b" status: 404 len: 154 microversion: 2.1 time: 0.108044 Oct 24 13:49:37.473673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 444/888] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:49:37 2022] DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b/os-volume_attachments/6c83a9b1-9ecb-48a3-aeb1-ee655f81ee7b => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:49:37.486288 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:37.495257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:37.497348 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:37.498563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-eb163f10-45ac-4a60-a4d8-7da5eec45ca1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1724 microversion: 2.20 time: 0.173596 Oct 24 13:49:37.499098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 445/889] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:37 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:49:38.159479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-a966951e-0e0e-4914-92de-7286864a9cca req-1aa7b9f9-b358-4a2f-b0ed-28f0aaabe200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586f4ffe-7aa6-4602-a4bd-48b62c92198f", "name": "network-vif-deleted", "tag": "07c0c60c-b6e6-4992-af52-d3d7c785897b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:38.180375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-a966951e-0e0e-4914-92de-7286864a9cca req-1aa7b9f9-b358-4a2f-b0ed-28f0aaabe200 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.181943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:38.182392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-a966951e-0e0e-4914-92de-7286864a9cca req-1aa7b9f9-b358-4a2f-b0ed-28f0aaabe200 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.183117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-a966951e-0e0e-4914-92de-7286864a9cca req-1aa7b9f9-b358-4a2f-b0ed-28f0aaabe200 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.185092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:38.200401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.201309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.201982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.202953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.203619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.204249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.204894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-a966951e-0e0e-4914-92de-7286864a9cca req-1aa7b9f9-b358-4a2f-b0ed-28f0aaabe200 service nova] Creating event network-vif-deleted:07c0c60c-b6e6-4992-af52-d3d7c785897b for instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f on hv-cinder-86249 Oct 24 13:49:38.213778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-a966951e-0e0e-4914-92de-7286864a9cca req-1aa7b9f9-b358-4a2f-b0ed-28f0aaabe200 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060426 Oct 24 13:49:38.215082 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 445/890] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:38.251334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b79fe1af-6fa4-4a10-a919-30e53bfa963d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073481 Oct 24 13:49:38.252178 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 446/891] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:49:38 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 13:49:38.329040 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:38.329632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:38.338298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.339057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.339727 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.340613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.341231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.341813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.373757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:49:38.472268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7035893e-ce54-419e-b2ac-f665b9ce330d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 204 len: 0 microversion: 2.1 time: 0.148572 Oct 24 13:49:38.476359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 446/892] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:49:38 2022] DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:49:38.481448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:38.482054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:38.491224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.491709 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.492139 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.492829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.493276 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.493695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.525983 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:38.527036 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:38.533725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.534234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.534675 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.536166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.536621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.538602 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.574657 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.575137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.575582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.576023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lazy-loading 'fault' on Instance uuid 586f4ffe-7aa6-4602-a4bd-48b62c92198f {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:38.627015 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:38.636438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:38.637889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:38.639080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-43d38d92-6c69-4bb5-8a89-a85d61b86476 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1372 microversion: 2.20 time: 0.117643 Oct 24 13:49:38.639947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 447/893] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:38 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:49:38.645436 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:38.645935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:38.649544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:38.651933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.652424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.652861 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.653561 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.654013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.654463 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.659084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ec827a0a-45fe-4cc1-8c33-f7c4b7b23b81 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1675 microversion: 2.1 time: 0.181432 Oct 24 13:49:38.659637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 447/894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:38 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:38.674119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:38.681216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:49:38.760443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-edc5fe79-8113-4dee-a9db-ce9dddf8c0b1 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 204 len: 0 microversion: 2.1 time: 0.119264 Oct 24 13:49:38.761421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 448/895] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:49:38 2022] DELETE /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:49:38.769404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:38.770020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:38.775961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.776439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.776876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.777581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:38.778015 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:38.778540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:38.923759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:38.932532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-aca49591-d652-44d3-b39b-ba3a5a6c70f9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1552 microversion: 2.1 time: 0.166985 Oct 24 13:49:38.933095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 448/896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:38 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:39.669094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:39.669789 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:39.676523 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.677001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.677431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:39.678112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.678580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.679000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:39.682508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:39.683195 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:39.689594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.690071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.690534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:39.691283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.691821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.692290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:39.713287 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.713772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.714221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:39.714669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lazy-loading 'fault' on Instance uuid 586f4ffe-7aa6-4602-a4bd-48b62c92198f {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:39.757855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:39.766325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:39.767778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:39.768911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4642bcb1-045d-45cd-bfba-e8d22be96e89 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1372 microversion: 2.20 time: 0.104074 Oct 24 13:49:39.770000 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 449/897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:39 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:39.828575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:39.836855 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-40044fca-70ac-4fb9-832f-c7aaf5fd408d tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1675 microversion: 2.1 time: 0.158350 Oct 24 13:49:39.837411 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 449/898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:39 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:39.957847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:39.958416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:39.964423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.964875 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.965305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:39.965991 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:39.966484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:39.966908 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:40.101587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:40.109170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-26df111e-83e9-4318-bc1b-99ca0975226c tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1552 microversion: 2.1 time: 0.156300 Oct 24 13:49:40.109730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 450/899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:39 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:40.794246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:40.794856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:40.802037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:40.803002 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:40.803435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:40.804203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:40.804653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:40.805076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:40.836648 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:40.837118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:40.837542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:40.837981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lazy-loading 'fault' on Instance uuid 586f4ffe-7aa6-4602-a4bd-48b62c92198f {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:40.860954 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:40.861621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:40.869205 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:40.869877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:40.870342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:40.871039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:40.871490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:40.871911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:40.880166 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:40.888003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:40.889431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:40.890597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-996d611b-62f5-4f4e-976a-3f15b30e8c80 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 200 len: 1372 microversion: 2.20 time: 0.100195 Oct 24 13:49:40.891145 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 450/900] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:40 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:41.003513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:41.011170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-54640229-b8a2-46ca-9c83-ae76f6ff247f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1675 microversion: 2.1 time: 0.154289 Oct 24 13:49:41.011728 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 451/901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:40 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:41.132896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:41.133503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:41.139345 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:41.139817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:41.140244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:41.140918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:41.141363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:41.141776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:41.271681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:41.279552 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d89bc834-f58f-4bfc-8744-8844b2037458 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1552 microversion: 2.1 time: 0.150726 Oct 24 13:49:41.280107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 451/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:41 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:41.916707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:41.917323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:41.923785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:41.924274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:41.924708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:41.925404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:41.925974 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:41.926296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:41.940166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] HTTP exception thrown: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Request method failure captured: Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f HTTP/1.1 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpaTkgYqIo1A2ewO-Ik484rOhKjXAEiRO6HpW1_BRlHqRYtu2K3PA-kAZxqsk59KmkI6GFpH1_xxfUZiKSq0amOnamOEwDhJnJHMBwQzjDRIep3i4DpMIZueYg0WekFWoY_kLJaroKZYu6GU8isxL6pT0DA-pd8zLWUVk_6ePfikivQ Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:49:41.941856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a578ee882e60456392c88a508d1a6db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 16228db2ddd147969482871b600ac797 Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:49:41.943850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '586f4ffe-7aa6-4602-a4bd-48b62c92198f'} Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:49:41.944784 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:49:41.946316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:41.949164 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Returning 404 to user: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:49:41.949164 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c798334b-4e29-49c1-be95-9da81e453b40 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 404 len: 111 microversion: 2.20 time: 0.030496 Oct 24 13:49:41.949164 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 452/903] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:41 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:49:41.952338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5f9d84aa-42ed-4d70-bcff-be924d22d043 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '.version_select at 0x7f8dc2892040>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:41.970474 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5f9d84aa-42ed-4d70-bcff-be924d22d043 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082965524" status: 204 len: 0 microversion: 2.20 time: 0.021914 Oct 24 13:49:41.971083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 452/904] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 24 13:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082965524 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:49:42.034772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:42.035576 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:42.042123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:42.042655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:42.043090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:42.043845 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:42.044297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:42.044747 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:42.305217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:42.306151 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:42.313697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:42.314426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:42.314894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:42.315901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:42.316604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:42.317998 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:42.332768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:42.365669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4c614d45-e555-4abe-8f63-9e5cf7871060 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1675 microversion: 2.1 time: 0.334994 Oct 24 13:49:42.392643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 453/905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:42 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1675 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:42.406977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e926bb8de284795bb6ebbda2dccc266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5243c296c8cb4467bfd269e4622e1adb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:42.415738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1fe1f5a7-1ac6-4671-b560-d1fcfe9534ac tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 200 len: 1510 microversion: 2.1 time: 0.115765 Oct 24 13:49:42.435644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 453/906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:42 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 1510 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:42.487123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-627d858f-ddd6-42fd-b48d-641ec1444377 req-ec56cbec-7cea-4b64-9049-4795c1b8e228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946bcf67-fae7-4721-bf74-302318834a6b", "name": "network-vif-deleted", "tag": "7b7a8dbf-45be-45cc-bd21-3d784915e6d5"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:42.500997 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-627d858f-ddd6-42fd-b48d-641ec1444377 req-ec56cbec-7cea-4b64-9049-4795c1b8e228 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:42.501776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-627d858f-ddd6-42fd-b48d-641ec1444377 req-ec56cbec-7cea-4b64-9049-4795c1b8e228 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:42.502521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-627d858f-ddd6-42fd-b48d-641ec1444377 req-ec56cbec-7cea-4b64-9049-4795c1b8e228 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:42.526742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-627d858f-ddd6-42fd-b48d-641ec1444377 req-ec56cbec-7cea-4b64-9049-4795c1b8e228 service nova] Creating event network-vif-deleted:7b7a8dbf-45be-45cc-bd21-3d784915e6d5 for instance 946bcf67-fae7-4721-bf74-302318834a6b on hv-cinder-86249 Oct 24 13:49:42.534067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-627d858f-ddd6-42fd-b48d-641ec1444377 req-ec56cbec-7cea-4b64-9049-4795c1b8e228 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060520 Oct 24 13:49:42.534920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 454/907] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:42.697986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bf78b634-ab40-43fa-9921-6c74abb0a585 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'create', calling method: .version_select at 0x7f8dc286c430>, body: {"keypair": {"name": "tempest-keypair-1882564882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlxeQLaeJPLegEKXJkLL8nnsL+ReS6EH3KTNlh9IxlZszdzCaU6WXVGruD8RkYxZQGSnPfVvhaTBXJRWny4LLj4gmsRlVtG2XINYqPL21gcP4S1ED4It8uKOqYAQ/Rmxw=="}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:42.713560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-bf78b634-ab40-43fa-9921-6c74abb0a585 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for project a578ee882e60456392c88a508d1a6db3. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:49:42.719033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-bf78b634-ab40-43fa-9921-6c74abb0a585 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for user 16228db2ddd147969482871b600ac797 and project a578ee882e60456392c88a508d1a6db3. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:49:42.742677 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bf78b634-ab40-43fa-9921-6c74abb0a585 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049152 Oct 24 13:49:42.743578 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 454/908] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 24 13:49:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 13:49:43.399860 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:43.400624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:43.411403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.412179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.422990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.425116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.427897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.428777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.447553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:43.448037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] [instance: 946bcf67-fae7-4721-bf74-302318834a6b] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:43.454731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.455505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.456146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.457054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.457727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.458396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.474635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] HTTP exception thrown: Instance 946bcf67-fae7-4721-bf74-302318834a6b could not be found. Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Request method failure captured: Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b HTTP/1.1 Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpa4ftIAtqwRUZszU_qZCADb9NsHN_2ruZ49GXxjbNA1yEeoh19be1HoBgPwbIODafZJjla_AA6PKHnz28Y1-73396X2U24Z4l7mwdOkqIFKgJlZ5AdwYRqsz62s3Rw5yY7Mm8xGVE59lLPOslMGhuoKEGuM8AKDJFAL64II2YkpiLI Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: 5243c296c8cb4467bfd269e4622e1adb Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-TestMinimumBasicScenario-1833458857 Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:49:43.477039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5243c296c8cb4467bfd269e4622e1adb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-TestMinimumBasicScenario-1833458857 Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: 5243c296c8cb4467bfd269e4622e1adb Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1833458857 Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-TestMinimumBasicScenario-1833458857-project Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 6e926bb8de284795bb6ebbda2dccc266 Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-TestMinimumBasicScenario-1833458857-project Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 946bcf67-fae7-4721-bf74-302318834a6b could not be found. Oct 24 13:49:43.478439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '946bcf67-fae7-4721-bf74-302318834a6b'} Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946bcf67-fae7-4721-bf74-302318834a6b could not be found. Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:49:43.479188 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946bcf67-fae7-4721-bf74-302318834a6b could not be found. Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946bcf67-fae7-4721-bf74-302318834a6b could not be found. Oct 24 13:49:43.480396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:49:43.481485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.481485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.481485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.481485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lazy-loading 'fault' on Instance uuid b4bf2855-1081-401a-a540-af8ef43dc1c8 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:43.483232 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Returning 404 to user: Instance 946bcf67-fae7-4721-bf74-302318834a6b could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:49:43.484309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-eaa4530d-7db2-4833-b4e3-32918206a2d9 tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b" status: 404 len: 111 microversion: 2.1 time: 0.040780 Oct 24 13:49:43.488644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 455/909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:43 2022] GET /compute/v2.1/servers/946bcf67-fae7-4721-bf74-302318834a6b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:49:43.495517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-44f91db7-71f6-4195-b78a-9fa9ccfa67ef tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] Calling method '.version_select at 0x7f8dc2772af0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:43.519773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-44f91db7-71f6-4195-b78a-9fa9ccfa67ef tempest-TestMinimumBasicScenario-1833458857 tempest-TestMinimumBasicScenario-1833458857-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1891665364" status: 202 len: 0 microversion: 2.1 time: 0.029143 Oct 24 13:49:43.524341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 456/910] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 24 13:49:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1891665364 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:49:43.532202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:43.541803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f2ef2b96-39f8-4489-83a7-b8b32a79e322 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 200 len: 1328 microversion: 2.1 time: 0.146580 Oct 24 13:49:43.542649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 455/911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:43 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 1328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:43.735187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:43.744327 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:43.752936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.753531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.754201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.755604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:43.767416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:43.767897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:43.882818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'services' on Instance uuid 9579f437-ab71-4398-b0b8-9a0a9248866d {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:43.995460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5a2006bb-5471-4796-b7e7-1463fbb1d29e tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments/28f3c23f-aa6c-4494-b15a-cef9d0817c49" status: 202 len: 0 microversion: 2.1 time: 0.264329 Oct 24 13:49:44.006304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 457/912] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:49:43 2022] DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments/28f3c23f-aa6c-4494-b15a-cef9d0817c49 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:49:44.007726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:44.014159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:44.021913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:44.022937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:44.023798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:44.025006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:44.025669 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:44.026373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:44.070534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-20de604a-f4ef-473a-8833-31d6d036d749 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069780 Oct 24 13:49:44.075865 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 456/913] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:49:43 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:44.408126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454874381", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b92dd60-38ed-4cb0-991e-04c8532ad07a"}], "security_groups": [{"name": "tempest-securitygroup--1902470687"}], "key_name": "tempest-keypair-1882564882", "user_data": "}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:44.517493 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] validate_networks() for [('3b92dd60-38ed-4cb0-991e-04c8532ad07a', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:49:44.565061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:44.565820 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:44.577245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:44.577957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:44.578754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:44.579727 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:44.580341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:44.580924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:44.597589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] HTTP exception thrown: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Request method failure captured: Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 HTTP/1.1 Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYdRGNdldiJ-8MAIQuemeHtnlAMXCp3Tmlpai2WH51G6MYeOraLI2rIk8Bmrd2eXv0Vs2nQXJ3e7bndmkKFC96dwWQBjV9rFF0sG8PbH-deyFOASuIfKju4go4CnFaevTIgNEaVMPKoCp7T786Qv_75Bj8BtTu0qecwDdycfO6ZXoY Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:49:44.600621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1ea8feefb0614972898c1b1ad28077a8 Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:49:44.602298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'b4bf2855-1081-401a-a540-af8ef43dc1c8'} Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:49:44.603273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:49:44.604730 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:44.606209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Returning 404 to user: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:49:44.606209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2d2c0fed-70cb-429e-970b-6ba2ad497499 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 404 len: 111 microversion: 2.1 time: 0.041691 Oct 24 13:49:44.606209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 457/914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:44 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:49:44.609217 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-5d2a9793-10e1-4ed2-bf7b-ec7198c6e2c9 req-ce4a056d-8b11-4462-9a34-171c47dcaa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bf2855-1081-401a-a540-af8ef43dc1c8", "name": "network-vif-deleted", "tag": "bf5a05a5-0f38-47bd-8c1b-ac1cc249329b"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:44.619244 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-5d2a9793-10e1-4ed2-bf7b-ec7198c6e2c9 req-ce4a056d-8b11-4462-9a34-171c47dcaa32 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:44.619646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-5d2a9793-10e1-4ed2-bf7b-ec7198c6e2c9 req-ce4a056d-8b11-4462-9a34-171c47dcaa32 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:44.620089 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-5d2a9793-10e1-4ed2-bf7b-ec7198c6e2c9 req-ce4a056d-8b11-4462-9a34-171c47dcaa32 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:44.633909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-5d2a9793-10e1-4ed2-bf7b-ec7198c6e2c9 req-ce4a056d-8b11-4462-9a34-171c47dcaa32 service nova] Creating event network-vif-deleted:bf5a05a5-0f38-47bd-8c1b-ac1cc249329b for instance b4bf2855-1081-401a-a540-af8ef43dc1c8 on hv-cinder-86249 Oct 24 13:49:44.639248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-5d2a9793-10e1-4ed2-bf7b-ec7198c6e2c9 req-ce4a056d-8b11-4462-9a34-171c47dcaa32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034262 Oct 24 13:49:44.640369 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 458/915] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:44.646046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-747092cd-13cb-4186-b828-325f15dd9850 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '.version_select at 0x7f8dc2bf1d30>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:44.670420 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-747092cd-13cb-4186-b828-325f15dd9850 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467644426" status: 202 len: 0 microversion: 2.1 time: 0.028601 Oct 24 13:49:44.671322 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 459/916] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 24 13:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467644426 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:49:45.011463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:49:45.011889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:49:45.012366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:49:45.012778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:49:45.013190 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:49:45.022762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.023249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.023688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.024422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.024879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.025305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.042899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for project a578ee882e60456392c88a508d1a6db3. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:49:45.046886 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Getting quotas for user 16228db2ddd147969482871b600ac797 and project a578ee882e60456392c88a508d1a6db3. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:49:45.058894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:49:45.061290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:49:45.085341 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:45.088268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:45.096491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.097098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.097806 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.099169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.100608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.101268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.111968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-62aca8f4-fe09-4d1f-9e96-b2dba6b76f3a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.708789 Oct 24 13:49:45.112628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 458/917] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 24 13:49:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 13:49:45.125214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a3d9c3ce-9e16-434f-91bc-9f440378f80f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:45.125915 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a3d9c3ce-9e16-434f-91bc-9f440378f80f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:45.136478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d0b1dd5e-92bd-4a15-a308-5af8b9c8dc31 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056788 Oct 24 13:49:45.137702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 460/918] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:49:45 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 13:49:45.219060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a3d9c3ce-9e16-434f-91bc-9f440378f80f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:45.225277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:45.225594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a3d9c3ce-9e16-434f-91bc-9f440378f80f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:45.225785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:45.228368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a3d9c3ce-9e16-434f-91bc-9f440378f80f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:45.230779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a3d9c3ce-9e16-434f-91bc-9f440378f80f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1282 microversion: 2.20 time: 0.108967 Oct 24 13:49:45.235280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 459/919] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:45 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:45.236650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.237481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.240706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.241652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.242367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.242946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.278117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:49:45.385080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-81a79df5-68b4-40f1-be14-e37c9ff746d1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 204 len: 0 microversion: 2.1 time: 0.167658 Oct 24 13:49:45.388837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 461/920] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:49:45 2022] DELETE /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:49:45.402626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:45.403463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:45.424276 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.425263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.427946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.429133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:45.429608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:45.430045 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:45.667044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:45.675711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-71642e66-115b-4d7e-9825-22055ff9960f tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1688 microversion: 2.1 time: 0.285384 Oct 24 13:49:45.677745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 460/921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:45 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1688 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:45.940481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b1ef7a5f-d0b5-4b73-aa22-e84b2d84ccf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: .version_select at 0x7f8dc2a778b0>, body: {"keypair": {"name": "tempest-keypair-101169168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBSwp6Cdh8EKphZZ9KHiHzamMDKKEJ4GSb6ZZZRmfVX7nNHHtiGtO5O8AMDmLAaZA2NBl2QEtlWcWEuKBydAysksivomMU84hjuhNlgIN/chiKcZ6IrIBot0vgtwVi83Q=="}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:45.958732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-b1ef7a5f-d0b5-4b73-aa22-e84b2d84ccf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:49:45.963499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-b1ef7a5f-d0b5-4b73-aa22-e84b2d84ccf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for user 1ea8feefb0614972898c1b1ad28077a8 and project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:49:45.992659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b1ef7a5f-d0b5-4b73-aa22-e84b2d84ccf5 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056180 Oct 24 13:49:45.993325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 462/922] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:49:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:46.260113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:46.261082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:46.267294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:46.268043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:46.268694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:46.269720 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:46.271217 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:46.272053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:46.277206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:46.345164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:46.355370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:46.356896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:46.357943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-29a41339-cb18-42f1-84c4-bd7f78566ec3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1286 microversion: 2.20 time: 0.101898 Oct 24 13:49:46.358836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 461/923] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:46 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:46.702122 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:46.703235 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:46.719046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:46.721951 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:46.723819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:46.723819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:46.724830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:46.725469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:46.726057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:46.970988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:46.980682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-553a6e5c-1e02-4380-8233-edab0cf3fcbd tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1688 microversion: 2.1 time: 0.284312 Oct 24 13:49:46.984476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 463/924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:46 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1688 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:47.384581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:47.385960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:47.392410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:47.392883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:47.393351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:47.394268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:47.394718 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:47.395883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:47.467315 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:47.475891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:47.477448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:47.479259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ab468d78-af4a-431d-8689-0b574108d16d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1286 microversion: 2.20 time: 0.099039 Oct 24 13:49:47.494387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 462/925] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:47 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:47.698473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-837186566", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf4eb23c-4dfb-45bd-a95b-d5fc238c5b23"}], "security_groups": [{"name": "tempest-securitygroup--1131319695"}], "key_name": "tempest-keypair-101169168", "user_data": "}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:47.877414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] validate_networks() for [('bf4eb23c-4dfb-45bd-a95b-d5fc238c5b23', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:49:48.009029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:48.009644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:48.023533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:48.024084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:48.024491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:48.025413 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:48.025879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:48.026342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:48.264666 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:48.278074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-386ca5cc-6c6e-466b-9db7-36834be0222b tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1688 microversion: 2.1 time: 0.270770 Oct 24 13:49:48.291306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 463/926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:48 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1688 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:48.418986 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:49:48.419996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:49:48.420483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:49:48.420895 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:49:48.421305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:49:48.439821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:48.440319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:48.440752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:48.441513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:48.442530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:48.443225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:48.469384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:49:48.474733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Getting quotas for user 1ea8feefb0614972898c1b1ad28077a8 and project e0f08e43a5984a9398b3d5ec41e4282c. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:49:48.489359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:49:48.492072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:49:48.513147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:48.513795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:48.524574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:48.525063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:48.534803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:48.535678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:48.536558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:48.537010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:48.548838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4503927d-de75-488b-a822-7e7948029427 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854620 Oct 24 13:49:48.549578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 464/927] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:49:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:49:48.560979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-09f8ca2f-14bc-42d6-b909-6d4ef2c31ae7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:48.561594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-09f8ca2f-14bc-42d6-b909-6d4ef2c31ae7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:48.618271 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-09f8ca2f-14bc-42d6-b909-6d4ef2c31ae7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:48.626939 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-09f8ca2f-14bc-42d6-b909-6d4ef2c31ae7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1236 microversion: 2.1 time: 0.069782 Oct 24 13:49:48.628047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 465/928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:48 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:48.684798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:48.693736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:48.695415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:48.696714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f3b319e2-03db-49c5-83b2-7bda5c3e5ecf tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1334 microversion: 2.20 time: 0.193895 Oct 24 13:49:48.697262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 464/929] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:48 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:49.303929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:49.304847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:49.319335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:49.320112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:49.320758 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:49.321699 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:49.322642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:49.323283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:49.653208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:49.656781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:49.664103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:49.664831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:49.665357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:49.666070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:49.667343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:49.667766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:49.741715 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:49.751112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b4afbc90-57e9-4591-907f-2db6dd094744 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1288 microversion: 2.1 time: 0.101912 Oct 24 13:49:49.751679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 465/930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:49 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:49.762939 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:49.764080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:49.773625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:49.774212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:49.774708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:49.775432 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:49.775971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:49.776291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:49.840074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:49.849016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:49.850779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:49.851937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3761c2f6-87db-4dc8-99c8-4d63db8e43df tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1340 microversion: 2.20 time: 0.099165 Oct 24 13:49:49.852490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 466/931] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:49 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:49.878510 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:49.886081 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-26ddd3c1-5dff-4582-bf73-537b98878a1c tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1688 microversion: 2.1 time: 0.586974 Oct 24 13:49:49.886913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 466/932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:49 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1688 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:50.776206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:50.776821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:50.784129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:50.784606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:50.785034 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:50.785761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:50.786325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:50.786745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:50.848948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:50.856650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-20faac55-36ed-4bca-bbd9-d4c772cb5984 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1294 microversion: 2.1 time: 0.084393 Oct 24 13:49:50.857150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 467/933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:50 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:50.877526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:50.878330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:50.885713 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:50.886320 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:50.886783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:50.887539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:50.888059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:50.888548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:50.910069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:50.912199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:50.913388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:50.932284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:50.932915 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:50.933450 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:50.934985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:50.935725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:50.936163 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:50.999253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:51.007567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4ad93a81-0cc6-4823-a31a-6566b9fa3328 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1621 microversion: 2.1 time: 0.101328 Oct 24 13:49:51.008417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 468/934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:50 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1621 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:51.026203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:51.034745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:51.036836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:51.037979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4d0edcb0-2919-476b-8220-5854698e3d8d tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1340 microversion: 2.20 time: 0.164392 Oct 24 13:49:51.038566 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 467/935] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:50 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:51.492714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-f4c73294-3210-493c-8596-de8bb9e67c38 req-fcfd69b3-89f1-4c78-85e8-ec556d6a10f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9579f437-ab71-4398-b0b8-9a0a9248866d", "name": "network-vif-deleted", "tag": "194721dc-2119-43f8-b40f-44906812d57a"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:51.513490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f4c73294-3210-493c-8596-de8bb9e67c38 req-fcfd69b3-89f1-4c78-85e8-ec556d6a10f6 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:51.514640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f4c73294-3210-493c-8596-de8bb9e67c38 req-fcfd69b3-89f1-4c78-85e8-ec556d6a10f6 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:51.515296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f4c73294-3210-493c-8596-de8bb9e67c38 req-fcfd69b3-89f1-4c78-85e8-ec556d6a10f6 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:51.529579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-f4c73294-3210-493c-8596-de8bb9e67c38 req-fcfd69b3-89f1-4c78-85e8-ec556d6a10f6 service nova] Creating event network-vif-deleted:194721dc-2119-43f8-b40f-44906812d57a for instance 9579f437-ab71-4398-b0b8-9a0a9248866d on hv-cinder-86249 Oct 24 13:49:51.535445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-f4c73294-3210-493c-8596-de8bb9e67c38 req-fcfd69b3-89f1-4c78-85e8-ec556d6a10f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053179 Oct 24 13:49:51.537922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 469/936] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:51.880545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:51.881191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:51.888170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:51.889355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:51.890037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:51.891035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:51.891703 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:51.892191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:52.032098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:52.032909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:52.042775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:52.043257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:52.044897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:52.045786 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:52.046588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:52.047178 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:52.084348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:52.119904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7558525e-468d-4dc4-bba2-7eacae371d74 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1294 microversion: 2.1 time: 0.243898 Oct 24 13:49:52.123099 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 468/937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:51 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1294 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:52.154878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:52.155720 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:52.163143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:52.163804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:52.164423 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:52.164548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:52.165114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:52.165413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:52.166345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:52.166345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:52.168362 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:52.169394 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'fault' on Instance uuid 9579f437-ab71-4398-b0b8-9a0a9248866d {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:49:52.267396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:52.277343 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-aaf6c822-04dc-4330-b47d-054ec1eb7e33 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 200 len: 1335 microversion: 2.1 time: 0.250309 Oct 24 13:49:52.277925 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 470/938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:52 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 1335 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:52.577524 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:52.589711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:52.591235 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:52.592564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8ae6bab2-5ef2-40aa-8e1c-517464aece34 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.468342 Oct 24 13:49:52.593357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 469/939] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:52 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:53.145113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:53.145736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:53.149266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:53.153468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:53.154227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:53.154671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:53.155378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:53.156081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:53.156668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:53.302084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:53.303374 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 9579f437-ab71-4398-b0b8-9a0a9248866d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:53.311007 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:53.311734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:53.312245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:53.312956 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:53.313419 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:53.313844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:53.321088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:53.328831 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] HTTP exception thrown: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d could not be found. Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Request method failure captured: Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d HTTP/1.1 Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYl-x2neo4NXAIMLiiF9DTr-DP3y40yUhgrDrnFH2vFUnkTTlsAjKaI46l-ToNo3WyNwj6m5yP_n7vsCfbyZtCTjs_PcHsDMqneWC3_8loL2hTnm65wLu4OYcTjb5_dlJLSvwvclAwu-B74UgwOIURmD-KGH19licV12odqlimpApw Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:49:53.331025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: be793f4685f94beba74adedbc02ee50a Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d could not be found. Oct 24 13:49:53.333035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '9579f437-ab71-4398-b0b8-9a0a9248866d'} Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d could not be found. Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:49:53.337249 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d could not be found. Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d could not be found. Oct 24 13:49:53.338822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:49:53.340119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Returning 404 to user: Instance 9579f437-ab71-4398-b0b8-9a0a9248866d could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:49:53.340119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-487b98a4-f5a6-470e-9c4e-5bfa78de3cf5 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d" status: 404 len: 111 microversion: 2.1 time: 0.035517 Oct 24 13:49:53.340119 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 470/940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:53 2022] GET /compute/v2.1/servers/9579f437-ab71-4398-b0b8-9a0a9248866d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:49:53.342536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-eb21ff95-afca-4111-a9de-ed6c33d26099 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.201031 Oct 24 13:49:53.345734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a159e21c-579f-4182-8e69-b317de16c0a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '.version_select at 0x7f8dc2b76a60>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:53.346628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 471/941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:53 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:53.374274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a159e21c-579f-4182-8e69-b317de16c0a2 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626614413" status: 202 len: 0 microversion: 2.1 time: 0.032650 Oct 24 13:49:53.374858 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 471/942] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 24 13:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626614413 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:49:53.618585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:53.620823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:53.627315 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:53.628133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:53.628719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:53.629808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:53.630467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:53.631047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:53.872667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:53.884130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:53.885754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:53.887094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-86a2e64e-65c4-4103-b999-367cccb0d790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.272774 Oct 24 13:49:53.899009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 472/943] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:53 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:54.370047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:54.370687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:54.381332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:54.382232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:54.382972 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:54.384419 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:54.385371 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:54.386045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:54.430725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-1195e912-3de3-44ad-9bb0-3126783f462e req-154191cc-0079-4df4-b551-8593bf95caf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:54.463072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-1195e912-3de3-44ad-9bb0-3126783f462e req-154191cc-0079-4df4-b551-8593bf95caf7 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:54.464113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-1195e912-3de3-44ad-9bb0-3126783f462e req-154191cc-0079-4df4-b551-8593bf95caf7 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:54.464547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-1195e912-3de3-44ad-9bb0-3126783f462e req-154191cc-0079-4df4-b551-8593bf95caf7 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:54.492750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-1195e912-3de3-44ad-9bb0-3126783f462e req-154191cc-0079-4df4-b551-8593bf95caf7 service nova] Creating event network-changed:21d722a6-32b9-4783-87d2-18e99bef65f0 for instance 41012da5-d2a4-4917-9415-3dfc4b40744c on hv-cinder-86249 Oct 24 13:49:54.499313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-1195e912-3de3-44ad-9bb0-3126783f462e req-154191cc-0079-4df4-b551-8593bf95caf7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075178 Oct 24 13:49:54.500443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 473/944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:49:54.737818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:54.756534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-bf9f1a38-854b-4faa-91a3-c041528c0ab1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.389555 Oct 24 13:49:54.776334 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 472/945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:54 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:54.914128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:54.915316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:54.932447 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:54.933447 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:54.934565 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:54.935559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:54.936125 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:54.937504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:55.033881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:55.201468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:55.213259 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:55.215952 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:55.217203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5c7bac17-f9aa-42ae-b21e-60139b64b5b5 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.307992 Oct 24 13:49:55.217998 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 474/946] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:54 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:55.789219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:55.789893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:55.801100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:55.801701 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:55.802073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:55.803843 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:55.804649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:55.804775 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:55.968333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:55.976448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-790cff99-5461-4697-ae06-7824c250bf93 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.194675 Oct 24 13:49:55.990547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 473/947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:55 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:56.245941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:56.246600 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:56.249592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=12 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:56.254062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.255235 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.255674 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.256575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.257028 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.257453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.405005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:56.413539 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:56.415016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:56.416130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-044473b0-d991-4b14-8f48-7884cfa8b67e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.174029 Oct 24 13:49:56.416685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 475/948] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:56 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:56.455451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:56.455965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:56.462401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.462883 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.463537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.464327 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.465045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.465504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.491753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:49:56.538431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-97f742a1-59ee-4e4e-a3d9-c640ec14b778 req-ab2fa165-a119-447c-a15d-251495fb7542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e", "tag": "4788cb10-6434-4341-ba33-145ca730f9c7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:49:56.548103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-97f742a1-59ee-4e4e-a3d9-c640ec14b778 req-ab2fa165-a119-447c-a15d-251495fb7542 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.548726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-97f742a1-59ee-4e4e-a3d9-c640ec14b778 req-ab2fa165-a119-447c-a15d-251495fb7542 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.549380 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-97f742a1-59ee-4e4e-a3d9-c640ec14b778 req-ab2fa165-a119-447c-a15d-251495fb7542 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.561608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-97f742a1-59ee-4e4e-a3d9-c640ec14b778 req-ab2fa165-a119-447c-a15d-251495fb7542 service nova] Creating event network-changed:4788cb10-6434-4341-ba33-145ca730f9c7 for instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e on hv-cinder-86249 Oct 24 13:49:56.568913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-97f742a1-59ee-4e4e-a3d9-c640ec14b778 req-ab2fa165-a119-447c-a15d-251495fb7542 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034557 Oct 24 13:49:56.569829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 476/949] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:49:56.579417 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a87e2a68-7a03-4454-ab6f-f2955eff7ed1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 204 len: 0 microversion: 2.1 time: 0.127536 Oct 24 13:49:56.579994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 474/950] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:49:56 2022] DELETE /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:49:56.589804 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:56.590531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:56.596841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.597525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.598622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.599666 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:56.600121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:56.600550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:56.744567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:56.752764 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-eb1c2fc9-5795-434b-a729-4754aec6da11 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1507 microversion: 2.1 time: 0.167119 Oct 24 13:49:56.753328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 477/951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:56 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:57.000088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:57.000827 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:57.007831 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:57.008312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:57.008739 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:57.009440 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:57.009873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:57.010534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:57.148454 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:57.159476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cb2ad04e-fb1b-48d2-bad8-356432622d37 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.164255 Oct 24 13:49:57.160813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 475/952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:56 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:57.442626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:57.443387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:57.450090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:57.450606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:57.451038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:57.451743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:57.452187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:57.452604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:57.594079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:57.602695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:57.604127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:57.605216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d1c02c97-d200-4b10-95ec-8336391e74da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.167067 Oct 24 13:49:57.606127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 478/953] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:57 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:57.776043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:57.776847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:57.783312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:57.783791 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:57.784225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:57.784914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:57.785982 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:57.786626 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:57.928117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:57.936200 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-916caa9a-713d-46a5-a576-bacc8c035cb9 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1507 microversion: 2.1 time: 0.164114 Oct 24 13:49:57.936771 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 476/954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:57 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:58.181451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:58.182056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:58.188063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:58.188535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:58.188963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:58.189642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:58.190088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:58.190528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:58.210425 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:58.322101 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:58.329680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2726eecd-4dd7-4541-a7c0-0d79d8da723f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.152231 Oct 24 13:49:58.330277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 479/955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:58 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:49:58.636617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:58.637238 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:58.639674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:58.640369 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=12 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:49:58.646742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:58.647228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:58.647665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:58.648357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:58.648815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:58.649235 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:58.791923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:58.800073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:58.801533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:58.802686 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0ef7056d-0faf-4ed4-ab00-48afb8847e93 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.170101 Oct 24 13:49:58.803250 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 477/956] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:58 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:49:58.960888 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:58.961516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:58.967650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:58.968128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:58.968557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:58.969244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:58.969696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:58.970117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:59.102858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:59.110722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d97f17da-bc99-49a0-b372-61702340de7d tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1507 microversion: 2.1 time: 0.154614 Oct 24 13:49:59.111289 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 480/957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:58 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:59.356181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:59.356795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:59.362866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:59.363343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:59.363978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:59.364632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:59.365122 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:59.365545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:59.496828 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:59.507508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6fbb5373-e82e-490e-a71f-4710d80057dd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.155201 Oct 24 13:49:59.508074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 478/958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:49:59 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:49:59.828332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:49:59.828940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:49:59.836184 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:59.837007 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:59.837684 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:59.838806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:49:59.839574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:49:59.840298 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:49:59.982880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:49:59.998535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:00.000414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:00.001966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5d458bd5-2022-42aa-9226-7b4626bc66e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.177248 Oct 24 13:50:00.002645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 481/959] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:49:59 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:50:00.020742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-3a3a3a4d-bc61-4a67-b5a7-9a8a21fda234 req-792a708b-9f3b-41ac-bafb-614bce7a21e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "name": "network-vif-plugged", "status": "completed", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:00.031648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3a3a3a4d-bc61-4a67-b5a7-9a8a21fda234 req-792a708b-9f3b-41ac-bafb-614bce7a21e4 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:00.032347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3a3a3a4d-bc61-4a67-b5a7-9a8a21fda234 req-792a708b-9f3b-41ac-bafb-614bce7a21e4 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:00.032755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3a3a3a4d-bc61-4a67-b5a7-9a8a21fda234 req-792a708b-9f3b-41ac-bafb-614bce7a21e4 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:00.045232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-3a3a3a4d-bc61-4a67-b5a7-9a8a21fda234 req-792a708b-9f3b-41ac-bafb-614bce7a21e4 service nova] Creating event network-vif-plugged:21d722a6-32b9-4783-87d2-18e99bef65f0 for instance 41012da5-d2a4-4917-9415-3dfc4b40744c on hv-cinder-86249 Oct 24 13:50:00.050200 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-3a3a3a4d-bc61-4a67-b5a7-9a8a21fda234 req-792a708b-9f3b-41ac-bafb-614bce7a21e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035004 Oct 24 13:50:00.050788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 479/960] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:00.134745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:00.135929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:00.142373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:00.142867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:00.143368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:00.144087 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:00.145219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:00.145819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:00.301199 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:00.309226 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-64828040-1e1f-4e07-8e38-617c70234434 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1507 microversion: 2.1 time: 0.178410 Oct 24 13:50:00.317618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 482/961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:00 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:50:00.534054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:00.535045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:00.541744 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:00.542257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:00.542688 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:00.543386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:00.543830 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:00.544434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:01.027589 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:01.028848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:01.035909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:01.036515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:01.037030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:01.038465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:01.038686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:01.039120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:01.175645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:01.186647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:01.188285 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:01.189761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bb564cf2-49c0-44f4-92b7-b555f4b7ce5f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.166008 Oct 24 13:50:01.190378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 483/962] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:50:01 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:50:01.271503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:01.279656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c14c0819-823a-4c7b-a783-a88589dd7808 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.750026 Oct 24 13:50:01.280233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 480/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:00 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:50:01.334196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:01.334847 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:01.340672 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:01.341147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:01.341581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:01.342372 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:01.342822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:01.343243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:01.502821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-3fe6482f-b2d4-4cbb-a1d0-e6b8cf318ec1 req-a7593347-0b8a-4f57-8432-2aa42e0e9458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372f925a-6a2d-47b9-b15c-b26dc8e87b27", "name": "network-vif-deleted", "tag": "0c46907e-0420-4a7c-8e45-431a4ca82ddd"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:01.517637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3fe6482f-b2d4-4cbb-a1d0-e6b8cf318ec1 req-a7593347-0b8a-4f57-8432-2aa42e0e9458 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:01.518086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3fe6482f-b2d4-4cbb-a1d0-e6b8cf318ec1 req-a7593347-0b8a-4f57-8432-2aa42e0e9458 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:01.524397 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:01.528680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-3fe6482f-b2d4-4cbb-a1d0-e6b8cf318ec1 req-a7593347-0b8a-4f57-8432-2aa42e0e9458 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:01.537696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-35676fb0-fd1f-4337-aeeb-e3dd2273f628 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1507 microversion: 2.1 time: 0.207815 Oct 24 13:50:01.538300 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 484/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:01 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:01.560299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-3fe6482f-b2d4-4cbb-a1d0-e6b8cf318ec1 req-a7593347-0b8a-4f57-8432-2aa42e0e9458 service nova] Creating event network-vif-deleted:0c46907e-0420-4a7c-8e45-431a4ca82ddd for instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 on hv-cinder-86249 Oct 24 13:50:01.571156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-3fe6482f-b2d4-4cbb-a1d0-e6b8cf318ec1 req-a7593347-0b8a-4f57-8432-2aa42e0e9458 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072253 Oct 24 13:50:01.573096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 481/965] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:50:02.214965 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:02.215564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:02.224258 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.224992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.225584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.226483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.227233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.228414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.304392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:02.305327 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:02.313900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.314751 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.315253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.316022 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.316785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.317973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.390881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:02.402042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:02.403517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:02.404756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5bfd4f09-5e44-4e31-8e9d-13cee16accfb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1408 microversion: 2.20 time: 0.194033 Oct 24 13:50:02.415123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 485/966] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:50:02 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:50:02.468793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:02.477772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1d806581-616e-4ccb-979c-46c989fa2017 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.178060 Oct 24 13:50:02.478095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 482/967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:02 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:50:02.561622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:02.562265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:02.568059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.568542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.568974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.569663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.570110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.570557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.601583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:02.602063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:02.602513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:02.602961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'fault' on Instance uuid 372f925a-6a2d-47b9-b15c-b26dc8e87b27 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:50:02.652964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:02.661506 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-53f5a080-a33a-4659-bf41-38866a41af56 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 200 len: 1312 microversion: 2.1 time: 0.103670 Oct 24 13:50:02.662056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 486/968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:02 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:03.430293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:03.430907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:03.437615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.438102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.438572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.439331 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.439871 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.440346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.499998 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:03.500576 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:03.507517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.508001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.508437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.509129 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.509584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.510008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.574515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:03.582881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:03.584348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:03.585526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-df9d223e-194b-4653-a9d6-0a8bbce9b5d4 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1600 microversion: 2.20 time: 0.159563 Oct 24 13:50:03.586091 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 483/969] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:50:03 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:50:03.610251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:03.610754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:03.617187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.617670 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.618109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.618835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.619285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.619711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.645143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:03.653168 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5c38b819-fde9-4dfc-8a84-3651fdd8865c tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.157197 Oct 24 13:50:03.653743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 487/970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:03 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:50:03.684599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:03.685214 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 372f925a-6a2d-47b9-b15c-b26dc8e87b27] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:03.691110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.691700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.692832 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.693510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.693967 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.694423 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.697026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-898eacff-694b-44c7-a6e5-23c1303dccc9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090497 Oct 24 13:50:03.697707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 484/971] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 24 13:50:03 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:50:03.708414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] HTTP exception thrown: Instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 could not be found. Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Request method failure captured: Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 HTTP/1.1 Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYl-x2neo4NXAIMLiiF9DTr-DP3y40yUhgrDrnFH2vFUnkTTlsAjKaI46l-ToNo3WyNwj6m5yP_n7vsCfbyZtCTjs_PcHsDMqneWC3_8loL2hTnm65wLu4OYcTjb5_dlJLSvwvclAwu-B74UgwOIURmD-KGH19licV12odqlimpApw Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:50:03.710146 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: be793f4685f94beba74adedbc02ee50a Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 could not be found. Oct 24 13:50:03.711729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '372f925a-6a2d-47b9-b15c-b26dc8e87b27'} Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 could not be found. Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:50:03.712528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 could not be found. Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 could not be found. Oct 24 13:50:03.713760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:03.715216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Returning 404 to user: Instance 372f925a-6a2d-47b9-b15c-b26dc8e87b27 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:50:03.715216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4dee1b52-4939-4376-8ef8-a6b2fb0fd871 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27" status: 404 len: 111 microversion: 2.1 time: 0.030857 Oct 24 13:50:03.715216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 488/972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:03 2022] GET /compute/v2.1/servers/372f925a-6a2d-47b9-b15c-b26dc8e87b27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:50:03.720237 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:03.720741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:03.727375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.727863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.728302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.729006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.729461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.729886 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.755406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:50:03.758348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:03.839052 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5616ba47-b09a-4ad9-afb1-52c52cc9cb39 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "DELETE /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 204 len: 0 microversion: 2.1 time: 0.122269 Oct 24 13:50:03.839917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 485/973] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:50:03 2022] DELETE /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:50:03.848712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:03.849471 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:03.855582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.856065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.856513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:03.857204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:03.857665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:03.858088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:04.005700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:04.014392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-257d5cd5-d491-4c96-a6ae-a55aab26c8c1 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.169823 Oct 24 13:50:04.018203 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 489/974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:03 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:04.186679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-f5972d0a-0cfe-41d8-a8f1-deb26485abfb req-c45f03a1-6eb8-4008-9c6e-14d234d0483d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e", "name": "network-vif-plugged", "status": "completed", "tag": "4788cb10-6434-4341-ba33-145ca730f9c7"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:04.200504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f5972d0a-0cfe-41d8-a8f1-deb26485abfb req-c45f03a1-6eb8-4008-9c6e-14d234d0483d service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:04.200504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f5972d0a-0cfe-41d8-a8f1-deb26485abfb req-c45f03a1-6eb8-4008-9c6e-14d234d0483d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:04.200504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f5972d0a-0cfe-41d8-a8f1-deb26485abfb req-c45f03a1-6eb8-4008-9c6e-14d234d0483d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:04.215728 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-f5972d0a-0cfe-41d8-a8f1-deb26485abfb req-c45f03a1-6eb8-4008-9c6e-14d234d0483d service nova] Creating event network-vif-plugged:4788cb10-6434-4341-ba33-145ca730f9c7 for instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e on hv-cinder-86249 Oct 24 13:50:04.224255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-f5972d0a-0cfe-41d8-a8f1-deb26485abfb req-c45f03a1-6eb8-4008-9c6e-14d234d0483d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042269 Oct 24 13:50:04.225670 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 486/975] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:04.676611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:04.677266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:04.683686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:04.684161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:04.684585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:04.685271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:04.685717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:04.686135 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:04.763658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-269089c3-d67c-45f6-ae45-cd2ae256e32a req-2fa46014-fce0-4f26-9462-44fb41f7f4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:04.775014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-269089c3-d67c-45f6-ae45-cd2ae256e32a req-2fa46014-fce0-4f26-9462-44fb41f7f4b1 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:04.775610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-269089c3-d67c-45f6-ae45-cd2ae256e32a req-2fa46014-fce0-4f26-9462-44fb41f7f4b1 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:04.776166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-269089c3-d67c-45f6-ae45-cd2ae256e32a req-2fa46014-fce0-4f26-9462-44fb41f7f4b1 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:04.788881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-269089c3-d67c-45f6-ae45-cd2ae256e32a req-2fa46014-fce0-4f26-9462-44fb41f7f4b1 service nova] Creating event network-changed:21d722a6-32b9-4783-87d2-18e99bef65f0 for instance 41012da5-d2a4-4917-9415-3dfc4b40744c on hv-cinder-86249 Oct 24 13:50:04.794940 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-269089c3-d67c-45f6-ae45-cd2ae256e32a req-2fa46014-fce0-4f26-9462-44fb41f7f4b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035145 Oct 24 13:50:04.795483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 487/976] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:50:04.823959 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:04.831625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6e239907-cc52-42ca-8739-d683c63664d9 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.159614 Oct 24 13:50:04.832817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 490/977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:04 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:05.039694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:05.040404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:05.046804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:05.047224 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:05.047659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:05.048350 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:05.048811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:05.049231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:05.322355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:05.330734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f13300f3-fdbf-4970-8d15-81f20dca3855 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1521 microversion: 2.1 time: 0.295408 Oct 24 13:50:05.345402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 488/978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:05 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:05.855224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:05.855842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:05.862272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:05.862761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:05.863231 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:05.864519 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:05.864981 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:05.865408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:06.003024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:06.010603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4357a4ab-af26-4c26-8ae5-4c75b3a64653 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1362 microversion: 2.1 time: 0.159342 Oct 24 13:50:06.011153 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 491/979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:05 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:06.353988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:06.354624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:06.361095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:06.361577 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:06.362008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:06.362763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:06.363214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:06.364202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:06.395453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:06.395930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:06.396366 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:06.396811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lazy-loading 'fault' on Instance uuid 40ad3d9a-2678-43ea-a489-650efa93034c {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:50:06.438196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be793f4685f94beba74adedbc02ee50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd506ce8ca200496cbc15d09f49eab942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:06.446134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7271ddf3-99d5-4dd5-8824-ed2b0a912bcc tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 200 len: 1312 microversion: 2.1 time: 0.095959 Oct 24 13:50:06.446722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 489/980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:06 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:06.810386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-160ab113-cbdd-414f-9606-bd747b8ecd3a req-a303548c-5693-496b-931f-dc4851a155df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ad3d9a-2678-43ea-a489-650efa93034c", "name": "network-vif-deleted", "tag": "549a039c-6659-4a3a-835f-b4a69f84e5f7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:06.820181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-160ab113-cbdd-414f-9606-bd747b8ecd3a req-a303548c-5693-496b-931f-dc4851a155df service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:06.820581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-160ab113-cbdd-414f-9606-bd747b8ecd3a req-a303548c-5693-496b-931f-dc4851a155df service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:06.821012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-160ab113-cbdd-414f-9606-bd747b8ecd3a req-a303548c-5693-496b-931f-dc4851a155df service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:06.831714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-160ab113-cbdd-414f-9606-bd747b8ecd3a req-a303548c-5693-496b-931f-dc4851a155df service nova] Creating event network-vif-deleted:549a039c-6659-4a3a-835f-b4a69f84e5f7 for instance 40ad3d9a-2678-43ea-a489-650efa93034c on hv-cinder-86249 Oct 24 13:50:06.837410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-160ab113-cbdd-414f-9606-bd747b8ecd3a req-a303548c-5693-496b-931f-dc4851a155df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 Oct 24 13:50:06.837988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 492/981] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:07.033211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:07.033852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:07.040689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:07.041175 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:07.041605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:07.042320 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:07.042776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:07.043197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:07.169287 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:07.176958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ba8ddb28-560a-4815-bbe8-aba4e2000e6f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1549 microversion: 2.1 time: 0.147999 Oct 24 13:50:07.177536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 490/982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:07 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:07.200706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:07.201284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:07.208182 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:07.208876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:07.209313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:07.210003 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:07.210483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:07.210899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:07.288417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ebb36ad9-7bd2-4286-b993-156b79b2ab17 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092400 Oct 24 13:50:07.289069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 493/983] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:50:07 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:07.469599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:07.470155 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] [instance: 40ad3d9a-2678-43ea-a489-650efa93034c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:07.477240 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:07.477719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:07.478147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:07.478855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:07.479305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:07.479724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:07.493913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] HTTP exception thrown: Instance 40ad3d9a-2678-43ea-a489-650efa93034c could not be found. Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Request method failure captured: Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c HTTP/1.1 Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYl-x2neo4NXAIMLiiF9DTr-DP3y40yUhgrDrnFH2vFUnkTTlsAjKaI46l-ToNo3WyNwj6m5yP_n7vsCfbyZtCTjs_PcHsDMqneWC3_8loL2hTnm65wLu4OYcTjb5_dlJLSvwvclAwu-B74UgwOIURmD-KGH19licV12odqlimpApw Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:50:07.495597 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d506ce8ca200496cbc15d09f49eab942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: d506ce8ca200496cbc15d09f49eab942 Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1819163027 Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: be793f4685f94beba74adedbc02ee50a Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1819163027-project Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 40ad3d9a-2678-43ea-a489-650efa93034c could not be found. Oct 24 13:50:07.497226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '40ad3d9a-2678-43ea-a489-650efa93034c'} Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ad3d9a-2678-43ea-a489-650efa93034c could not be found. Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:50:07.498029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ad3d9a-2678-43ea-a489-650efa93034c could not be found. Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ad3d9a-2678-43ea-a489-650efa93034c could not be found. Oct 24 13:50:07.499277 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:07.500362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] Returning 404 to user: Instance 40ad3d9a-2678-43ea-a489-650efa93034c could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:50:07.500362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9e5f1d3b-4093-4799-a3b6-39800f974ff8 tempest-ServerRescueNegativeTestJSON-1819163027 tempest-ServerRescueNegativeTestJSON-1819163027-project] 10.222.0.20 "GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c" status: 404 len: 111 microversion: 2.1 time: 0.031317 Oct 24 13:50:07.500362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 491/984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:07 2022] GET /compute/v2.1/servers/40ad3d9a-2678-43ea-a489-650efa93034c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:50:08.472626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-d9f2d1b8-e623-4528-806c-e20709e76050 req-2ba755d4-6a44-449f-96af-89079cc47e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e", "tag": "4788cb10-6434-4341-ba33-145ca730f9c7"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:08.485517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-d9f2d1b8-e623-4528-806c-e20709e76050 req-2ba755d4-6a44-449f-96af-89079cc47e56 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:08.486368 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-d9f2d1b8-e623-4528-806c-e20709e76050 req-2ba755d4-6a44-449f-96af-89079cc47e56 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:08.487478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-d9f2d1b8-e623-4528-806c-e20709e76050 req-2ba755d4-6a44-449f-96af-89079cc47e56 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:08.501187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-d9f2d1b8-e623-4528-806c-e20709e76050 req-2ba755d4-6a44-449f-96af-89079cc47e56 service nova] Creating event network-changed:4788cb10-6434-4341-ba33-145ca730f9c7 for instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e on hv-cinder-86249 Oct 24 13:50:08.507605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-d9f2d1b8-e623-4528-806c-e20709e76050 req-2ba755d4-6a44-449f-96af-89079cc47e56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038734 Oct 24 13:50:08.508935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 494/985] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:12.559979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a6a945af-7bb2-4d27-914e-20f16268fb8d tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Action: 'create', calling method: .version_select at 0x7f8dc2b1aee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1282350204", "metadata": {"Type": "work"}}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:12.883836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a6a945af-7bb2-4d27-914e-20f16268fb8d tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.484324 Oct 24 13:50:12.884488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 492/986] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 24 13:50:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 486 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 13:50:12.905017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9e3fef83-a2b3-4085-a4db-20cd640b55c8 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Calling method '.version_select at 0x7f8dc297f160>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:12.950440 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9e3fef83-a2b3-4085-a4db-20cd640b55c8 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276" status: 200 len: 353 microversion: 2.1 time: 0.055188 Oct 24 13:50:12.951095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 495/987] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:50:12 2022] GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:13.967167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d9b83798-5778-4581-a259-9fc617eff8cc tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Calling method '.version_select at 0x7f8dc2ced280>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:14.014537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d9b83798-5778-4581-a259-9fc617eff8cc tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276" status: 200 len: 354 microversion: 2.1 time: 0.051626 Oct 24 13:50:14.015103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 493/988] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:50:13 2022] GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:14.028501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-509ca2ad-31ac-41b0-b770-450d08851908 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Calling method '.version_select at 0x7f8dc29b45e0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:14.075464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-509ca2ad-31ac-41b0-b770-450d08851908 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276" status: 200 len: 354 microversion: 2.1 time: 0.051359 Oct 24 13:50:14.076058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 496/989] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:50:14 2022] GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:14.094236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9e9b1438-88c9-40af-9c45-57e4b34087f9 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Calling method '.version_select at 0x7f8dc2b1a160>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:14.157890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9e9b1438-88c9-40af-9c45-57e4b34087f9 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276" status: 202 len: 0 microversion: 2.1 time: 0.067499 Oct 24 13:50:14.158497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 494/990] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:50:14 2022] DELETE /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:50:14.167023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e0b3f47f-66b0-4754-9193-551648695fd4 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Calling method '.version_select at 0x7f8dc29b4f70>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:14.218628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e0b3f47f-66b0-4754-9193-551648695fd4 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276" status: 200 len: 353 microversion: 2.1 time: 0.055094 Oct 24 13:50:14.219205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 497/991] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:50:14 2022] GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:15.233406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-20dd54fc-125d-4cf4-a0d5-b790fa210a42 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Calling method '.version_select at 0x7f8dc61c7ca0>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:15.260049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-20dd54fc-125d-4cf4-a0d5-b790fa210a42 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] HTTP exception thrown: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-20dd54fc-125d-4cf4-a0d5-b790fa210a42 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Request method failure captured: Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 HTTP/1.1 Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpgUKbt4Cf-cx_-SrJwJwH7PGGQCt3mhTGVtlCWYXg1CrtcwxyFwmB3iJjIHX1ZrlbqXdPx0JLTocB3CDXhvxoZUyOGrph7Cu431mJ-ZHaCWGakikJW7WG8sJy2ToxWYu-PM7JknAdJdIkcfkDOtDFEdqZ7J7wKml_x2yNc1SiAqpzc Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: b1f0143283124ac6848b0df6d4c2d225 Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesGetTestJSON-1402412433 Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:50:15.262409 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b1f0143283124ac6848b0df6d4c2d225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b1f0143283124ac6848b0df6d4c2d225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b1f0143283124ac6848b0df6d4c2d225"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b1f0143283124ac6848b0df6d4c2d225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesGetTestJSON-1402412433 Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: b1f0143283124ac6848b0df6d4c2d225 Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesGetTestJSON-1402412433 Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesGetTestJSON-1402412433-project Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: ef2445015bec425db199fb986db76dee Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesGetTestJSON-1402412433-project Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '98fee148-d5ec-41d1-89d9-dc10cf0d0276'} Oct 24 13:50:15.264059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. (HTTP 404) (Request-ID: req-4126493f-832b-4e0a-ad47-973030723113) Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:15.265266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:50:15.266813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:50:15.268325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-20dd54fc-125d-4cf4-a0d5-b790fa210a42 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] Returning 404 to user: Volume 98fee148-d5ec-41d1-89d9-dc10cf0d0276 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-20dd54fc-125d-4cf4-a0d5-b790fa210a42 tempest-VolumesGetTestJSON-1402412433 tempest-VolumesGetTestJSON-1402412433-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276" status: 404 len: 109 microversion: 2.1 time: 0.034820 Oct 24 13:50:15.269867 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 495/992] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:50:15 2022] GET /compute/v2.1/os-volumes/98fee148-d5ec-41d1-89d9-dc10cf0d0276 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:50:17.732363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:17.733469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:17.741049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:17.741535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:17.741971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:17.742724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:17.743225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:17.743605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:17.771043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1ecf21cf-1c0c-4d54-a438-ddb43b1ab01b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/ips" status: 200 len: 149 microversion: 2.1 time: 0.042868 Oct 24 13:50:17.771626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 498/993] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:50:17 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:19.131894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:19.133052 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:19.138365 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44416405-deaf-45e4-92d2-ec595e7808ac"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:19.140726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:19.149424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:19.150039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:19.150670 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:19.151372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:19.151938 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:19.152242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:19.410349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4da6c386-1ac7-423f-bd90-6a162e4762c8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280924 Oct 24 13:50:19.411582 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 496/994] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:50:19 2022] POST /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:26.976274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44416405-deaf-45e4-92d2-ec595e7808ac"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:26.978615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:26.981086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=51 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:26.986246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:26.986720 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:26.987150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:26.987829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:26.988304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:26.988725 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:27.068962 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Invalid volume: volume 44416405-deaf-45e4-92d2-ec595e7808ac is already attached to instances: 5243fe8f-bbe8-4a2f-a52c-f013aba97508 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: POST /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments HTTP/1.1 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 74 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:50:27.070776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {"volumeAttachment": {"volumeId": "44416405-deaf-45e4-92d2-ec595e7808ac"}} Oct 24 13:50:27.072364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Invalid volume: volume 44416405-deaf-45e4-92d2-ec595e7808ac is already attached to instances: 5243fe8f-bbe8-4a2f-a52c-f013aba97508 Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'server_id': '5243fe8f-bbe8-4a2f-a52c-f013aba97508', 'body': {'volumeAttachment': {'volumeId': '44416405-deaf-45e4-92d2-ec595e7808ac'}}} Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 44416405-deaf-45e4-92d2-ec595e7808ac is already attached to instances: 5243fe8f-bbe8-4a2f-a52c-f013aba97508 Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:27.073189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 44416405-deaf-45e4-92d2-ec595e7808ac is already attached to instances: 5243fe8f-bbe8-4a2f-a52c-f013aba97508 Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:27.074414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 44416405-deaf-45e4-92d2-ec595e7808ac is already attached to instances: 5243fe8f-bbe8-4a2f-a52c-f013aba97508 Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 400 to user: Invalid volume: volume 44416405-deaf-45e4-92d2-ec595e7808ac is already attached to instances: 5243fe8f-bbe8-4a2f-a52c-f013aba97508 {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-96f93f05-07bf-4de5-ae06-266a06219864 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100616 Oct 24 13:50:27.075812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 499/995] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:50:26 2022] POST /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:50:27.143248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:27.143959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:27.150882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:27.151362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:27.151794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:27.152485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:27.152937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:27.153361 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:27.237682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lazy-loading 'services' on Instance uuid 5243fe8f-bbe8-4a2f-a52c-f013aba97508 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:50:27.313113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3f36e4bf-2283-4475-81b2-69f46f0d0bf3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments/44416405-deaf-45e4-92d2-ec595e7808ac" status: 202 len: 0 microversion: 2.1 time: 0.174825 Oct 24 13:50:27.313970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 497/996] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:50:27 2022] DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments/44416405-deaf-45e4-92d2-ec595e7808ac => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:50:27.323010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:27.325127 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:27.331239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:27.331770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:27.332249 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:27.333048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:27.334297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:27.334982 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:27.369846 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3b5e3888-c95c-4719-9adb-5f293742b40e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051506 Oct 24 13:50:27.370460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 500/997] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:50:27 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:28.383053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:28.385430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:28.392051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:28.392531 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:28.392965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:28.393698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:28.394096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:28.394542 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:28.424267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-726e263a-4f05-4467-9af4-5cb8d81d9001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045563 Oct 24 13:50:28.424810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 498/998] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:50:28 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:50:28.486999 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:28.487521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:28.494317 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:28.494791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:28.495216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:28.495896 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:28.496340 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:28.496753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:28.499264 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=97 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:28.523500 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:50:28.596374 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-798f0eb3-57c5-47dd-9a10-9534c72edf88 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 204 len: 0 microversion: 2.1 time: 0.112754 Oct 24 13:50:28.597111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 501/999] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:50:28 2022] DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:50:28.605868 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:28.606595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:28.612807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:28.613285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:28.613721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:28.614429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:28.615255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:28.615795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:28.744535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:28.752373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d22c12cc-7cf8-43d6-b038-7a2aa6f20006 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1679 microversion: 2.1 time: 0.150462 Oct 24 13:50:28.752936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 499/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:28 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:29.776834 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:29.777543 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:29.784175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:29.784655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:29.785089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:29.785773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:29.786251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:29.787389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:29.919357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:29.927759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-685d4f56-49e5-4bea-8d63-e761fc8e6abc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1679 microversion: 2.1 time: 0.155167 Oct 24 13:50:29.928319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 502/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:29 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:30.951295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:30.952114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:30.959636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:30.960213 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:30.960699 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:30.961402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:30.961855 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:30.962300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:31.142453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:31.150981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-600cda46-d1fa-4646-b5a8-010afe2ae304 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 200 len: 1679 microversion: 2.1 time: 0.203532 Oct 24 13:50:31.151549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 500/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:30 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:31.465170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-bea7de07-67a6-4464-a00b-b3ab7472d78b req-ac9af807-9d4d-46c2-81e8-9df1b0859caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5243fe8f-bbe8-4a2f-a52c-f013aba97508", "name": "network-vif-deleted", "tag": "700cb08c-be6b-43d8-9142-b1364a7108cd"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:31.477501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-bea7de07-67a6-4464-a00b-b3ab7472d78b req-ac9af807-9d4d-46c2-81e8-9df1b0859caf service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:31.477972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-bea7de07-67a6-4464-a00b-b3ab7472d78b req-ac9af807-9d4d-46c2-81e8-9df1b0859caf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:31.478429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-bea7de07-67a6-4464-a00b-b3ab7472d78b req-ac9af807-9d4d-46c2-81e8-9df1b0859caf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:31.492590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-bea7de07-67a6-4464-a00b-b3ab7472d78b req-ac9af807-9d4d-46c2-81e8-9df1b0859caf service nova] Creating event network-vif-deleted:700cb08c-be6b-43d8-9142-b1364a7108cd for instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 on hv-cinder-86249 Oct 24 13:50:31.498115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-bea7de07-67a6-4464-a00b-b3ab7472d78b req-ac9af807-9d4d-46c2-81e8-9df1b0859caf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036667 Oct 24 13:50:31.498916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 503/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:32.180015 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:32.181971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:32.189957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:32.193924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:32.199242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:32.200185 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:32.203063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:32.203539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:32.232483 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 HTTP/1.1 Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:50:32.234478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:50:32.235826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '5243fe8f-bbe8-4a2f-a52c-f013aba97508'} Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:50:32.236589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:50:32.237811 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:50:32.241668 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:50:32.243008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d65d8bf3-63a1-4706-8791-b8ca2b8217e7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 404 len: 111 microversion: 2.1 time: 0.071265 Oct 24 13:50:32.243486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 501/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:32 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:50:32.252953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-40094f8c-e84c-45c5-8c3d-a34e1a180af9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '.version_select at 0x7f8dc2808af0>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:32.274862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-40094f8c-e84c-45c5-8c3d-a34e1a180af9 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754411184" status: 202 len: 0 microversion: 2.1 time: 0.026494 Oct 24 13:50:32.275489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 504/1005] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 24 13:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754411184 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:50:33.020373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0a1f2f08-25d4-413d-a190-13629f301117 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: .version_select at 0x7f8dc61c7550>, body: {"keypair": {"name": "tempest-keypair-919808944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeCZtUqK+Dh2owSE0kiEZi3C/l94bCBpu8N3uaAE3uygXafYDMpiiAdJLpZBpkojPcKqhwW3KBilq/V2xurV90rypo2SYFJvqBrTupnhRfelH98BR4sbyz/peeLacZDTQ=="}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:33.036428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-0a1f2f08-25d4-413d-a190-13629f301117 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:50:33.041149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-0a1f2f08-25d4-413d-a190-13629f301117 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:50:33.063701 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0a1f2f08-25d4-413d-a190-13629f301117 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046977 Oct 24 13:50:33.064503 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 502/1006] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:50:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:34.406939 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-333110987", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "051d9444-c9f6-450e-99dd-61dcbd128cbe"}], "security_groups": [{"name": "tempest-securitygroup--441989891"}], "key_name": "tempest-keypair-919808944", "user_data": "}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:34.516324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] validate_networks() for [('051d9444-c9f6-450e-99dd-61dcbd128cbe', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:50:34.902490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:50:34.902911 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:50:34.903382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:50:34.903823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:50:34.904234 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:50:34.913520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:34.913999 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:34.914459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:34.915183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:34.915633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:34.916059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:34.934210 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:50:34.938115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Getting quotas for user 1461a94dd8ef48f79a0d8642a1bc1e58 and project ae58cf3c8178463296c8b633550a130e. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:50:34.950455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:50:34.952880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:50:35.001995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-80b5efea-60ec-4f56-a395-2b7a477f9bd0 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599944 Oct 24 13:50:35.002775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 505/1007] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:50:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:50:35.016215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6b118249-5644-414c-b284-cbe49567b03b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:35.016955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6b118249-5644-414c-b284-cbe49567b03b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:35.080791 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6b118249-5644-414c-b284-cbe49567b03b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:35.090047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6b118249-5644-414c-b284-cbe49567b03b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1240 microversion: 2.1 time: 0.078318 Oct 24 13:50:35.090970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 503/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:35 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:36.113392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:36.114014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:36.122342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:36.122950 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:36.123564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:36.124516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:36.124960 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:36.125553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:36.192088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:36.200860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fd07e82a-15f5-4e11-ac15-f4b0ce1a3217 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1310 microversion: 2.1 time: 0.092043 Oct 24 13:50:36.207504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 506/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:36 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:37.225734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:37.226587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:37.234348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:37.234829 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:37.235362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:37.236303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:37.239816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:37.240536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:37.434817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:37.444547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7c764a0a-6c09-49db-81d9-aa06aba070cc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.223667 Oct 24 13:50:37.445143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 504/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:37 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:37.579669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-81143887-5465-44f7-99fd-3ea48ee95313 req-ea4f75de-9928-4258-831f-e23652639462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3cfc03c-c908-414d-9102-509feacebab1", "tag": "21f67d0a-1a79-45cb-a359-195cfea065be"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:37.590873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-81143887-5465-44f7-99fd-3ea48ee95313 req-ea4f75de-9928-4258-831f-e23652639462 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:37.591596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-81143887-5465-44f7-99fd-3ea48ee95313 req-ea4f75de-9928-4258-831f-e23652639462 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:37.592797 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-81143887-5465-44f7-99fd-3ea48ee95313 req-ea4f75de-9928-4258-831f-e23652639462 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:37.608242 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-81143887-5465-44f7-99fd-3ea48ee95313 req-ea4f75de-9928-4258-831f-e23652639462 service nova] Creating event network-changed:21f67d0a-1a79-45cb-a359-195cfea065be for instance b3cfc03c-c908-414d-9102-509feacebab1 on hv-cinder-86249 Oct 24 13:50:37.613359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-81143887-5465-44f7-99fd-3ea48ee95313 req-ea4f75de-9928-4258-831f-e23652639462 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037640 Oct 24 13:50:37.613956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 507/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:38.471938 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:38.472558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:38.479645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:38.480120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:38.480543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:38.481232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:38.481759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:38.482217 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:38.613328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:38.621016 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f3838d62-b0fd-41d3-946b-a16abb4442d4 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.153063 Oct 24 13:50:38.621580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 505/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:38 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:39.644975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:39.645817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:39.651966 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:39.652446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:39.652880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:39.653573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:39.654026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:39.654480 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:39.783858 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:39.792115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-229577e6-9395-4151-8bc4-19e288efcdc2 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.151893 Oct 24 13:50:39.792671 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 508/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:39 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:40.815011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:40.815631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:40.823197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:40.823685 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:40.824124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:40.824818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:40.825272 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:40.825697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:40.966538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:40.974849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b21ab608-6651-48f6-9a44-1ec3d4b11273 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.163254 Oct 24 13:50:40.975419 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 506/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:40 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:50:41.997609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:41.998248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:42.004584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:42.005580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:42.006025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:42.006756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:42.007211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:42.007645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:42.152886 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:42.162357 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e072b0b9-4a2b-4215-b3a5-41d9d66afa0a tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.168417 Oct 24 13:50:42.166206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 509/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:41 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:43.186078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:43.186726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:43.194067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:43.194575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:43.195012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:43.195707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:43.196158 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:43.196578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:43.336889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:43.345002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-74e7c27e-ee86-42c4-87ee-88bad2df79e8 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.163691 Oct 24 13:50:43.345570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 507/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:43 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:44.368903 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:44.370688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:44.377279 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:44.378083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:44.378552 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:44.379459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:44.379917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:44.380376 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:44.396238 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-2c087a35-3d6f-4ddb-b6a0-8e31abee08e6 req-9edd453b-9034-4bda-8a01-dbe134685d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cfc03c-c908-414d-9102-509feacebab1", "name": "network-vif-plugged", "status": "completed", "tag": "21f67d0a-1a79-45cb-a359-195cfea065be"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:44.410717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-2c087a35-3d6f-4ddb-b6a0-8e31abee08e6 req-9edd453b-9034-4bda-8a01-dbe134685d8a service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:44.412721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-2c087a35-3d6f-4ddb-b6a0-8e31abee08e6 req-9edd453b-9034-4bda-8a01-dbe134685d8a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:44.413996 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-2c087a35-3d6f-4ddb-b6a0-8e31abee08e6 req-9edd453b-9034-4bda-8a01-dbe134685d8a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:44.426003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-2c087a35-3d6f-4ddb-b6a0-8e31abee08e6 req-9edd453b-9034-4bda-8a01-dbe134685d8a service nova] Creating event network-vif-plugged:21f67d0a-1a79-45cb-a359-195cfea065be for instance b3cfc03c-c908-414d-9102-509feacebab1 on hv-cinder-86249 Oct 24 13:50:44.432746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-2c087a35-3d6f-4ddb-b6a0-8e31abee08e6 req-9edd453b-9034-4bda-8a01-dbe134685d8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042272 Oct 24 13:50:44.433588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 508/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:50:44.594693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:44.603567 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e2bda874-64de-4cdd-a3a6-e68ba0a46087 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.239891 Oct 24 13:50:44.604503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 510/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:44 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:45.631288 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:45.631894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:45.633947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:45.640032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:45.640988 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:45.641558 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:45.642124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:45.642743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:45.643179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:45.940343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:45.960967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9cb9b8b6-80d3-45dd-b4fb-79fa38192d5f tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1365 microversion: 2.1 time: 0.334933 Oct 24 13:50:45.961572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 509/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:45 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:46.986395 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:46.987005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:46.994036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:46.999148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:47.003798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:47.004510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:47.005165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:47.011120 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:47.012373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:47.015102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:47.225490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:50:47.233946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-13ca1838-7fd6-4a77-8367-d56aeb18bf12 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1554 microversion: 2.1 time: 0.252218 Oct 24 13:50:47.234936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 511/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:50:46 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:50:47.258045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:50:47.259176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:50:47.265990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:47.266767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:47.267380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:47.268233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:47.268844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:47.269420 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:47.354479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d7a01cf8-e735-4bc6-867b-f98cabb85950 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100253 Oct 24 13:50:47.355067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 510/1021] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 24 13:50:47 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:48.439326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-817cbab9-1ca4-4c34-810a-7c749721f90c req-3fdb52bf-3bc9-43bc-8e78-24d77b7a127f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3cfc03c-c908-414d-9102-509feacebab1", "tag": "21f67d0a-1a79-45cb-a359-195cfea065be"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:48.450536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-817cbab9-1ca4-4c34-810a-7c749721f90c req-3fdb52bf-3bc9-43bc-8e78-24d77b7a127f service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:50:48.451371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-817cbab9-1ca4-4c34-810a-7c749721f90c req-3fdb52bf-3bc9-43bc-8e78-24d77b7a127f service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:50:48.452043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-817cbab9-1ca4-4c34-810a-7c749721f90c req-3fdb52bf-3bc9-43bc-8e78-24d77b7a127f service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:50:48.464096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-817cbab9-1ca4-4c34-810a-7c749721f90c req-3fdb52bf-3bc9-43bc-8e78-24d77b7a127f service nova] Creating event network-changed:21f67d0a-1a79-45cb-a359-195cfea065be for instance b3cfc03c-c908-414d-9102-509feacebab1 on hv-cinder-86249 Oct 24 13:50:48.470004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-817cbab9-1ca4-4c34-810a-7c749721f90c req-3fdb52bf-3bc9-43bc-8e78-24d77b7a127f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 Oct 24 13:50:48.470935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 512/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:50:54.396765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-604ec009-b7bc-4243-9457-7ec7afa61a8a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Action: 'create', calling method: .version_select at 0x7f8dc29f8ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-519842543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMKeoGtV94UzDLte0BBcmuDOJvNxEE6uLFe2wTHI/xqDO2Vn+axrUSBOemmVRauCob14Ii/qrLwlY0CfSPIY362+qfhHVQcJlsDAHCWbozGiLfBtEJtIb91vHxa6ror+A=="}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:50:54.402235 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:50:54.415538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-604ec009-b7bc-4243-9457-7ec7afa61a8a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for project 5db8c3fdabf94498948055239da40ca0. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:50:54.419564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-604ec009-b7bc-4243-9457-7ec7afa61a8a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for user 568d031158744101a6bb339e51149ed2 and project 5db8c3fdabf94498948055239da40ca0. Resources: {'key_pairs'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:50:54.442847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-604ec009-b7bc-4243-9457-7ec7afa61a8a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.213607 Oct 24 13:50:54.443444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 511/1023] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:50:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:51:18.204897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2090694196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-519842543", "security_groups": [{"name": "tempest-secgroup-smoke-2089865704"}], "block_device_mapping_v2": [{"uuid": "207db82b-099d-4cc0-996e-cb93e61e2a7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0a27a795-3bd6-4937-8a2d-83219efd0aaa"}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:18.215990 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:18.216636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:18.323787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] validate_networks() for [('0a27a795-3bd6-4937-8a2d-83219efd0aaa', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:51:18.690972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:51:18.691449 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:51:18.691924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:51:18.692334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:51:18.692743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:51:18.702216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:18.702704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:18.703137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:18.703862 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:18.704314 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:18.704736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:18.721711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for project 5db8c3fdabf94498948055239da40ca0. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:51:18.725667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for user 568d031158744101a6bb339e51149ed2 and project 5db8c3fdabf94498948055239da40ca0. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:51:18.782499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:51:18.784741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='207db82b-099d-4cc0-996e-cb93e61e2a7b',volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:51:18.916223 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-23a6a7ec-950e-408b-a141-fc168222ea9d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715481 Oct 24 13:51:18.916877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 513/1024] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:51:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:51:18.925193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:18.926228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=4 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:18.926767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:18.931529 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-905a7e14-0018-4d2e-8472-633feea19496 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:18.932148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-905a7e14-0018-4d2e-8472-633feea19496 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:18.990859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-905a7e14-0018-4d2e-8472-633feea19496 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:18.998418 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-905a7e14-0018-4d2e-8472-633feea19496 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1094 microversion: 2.1 time: 0.074443 Oct 24 13:51:18.998984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 512/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:18 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:20.021969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:20.022616 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:20.031464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:20.031946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:20.032587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:20.033282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:20.033733 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:20.034152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:20.105062 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:20.114452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9b72d1a1-ac29-44a5-be2a-01fedbd23a63 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1210 microversion: 2.1 time: 0.096760 Oct 24 13:51:20.115250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 514/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:20 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:21.137632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:21.138265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:21.144683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:21.145166 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:21.145595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:21.146318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:21.146769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:21.147192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:21.344414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:21.352094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b15a7fa5-a658-42a9-9ff8-891ff4946257 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.218900 Oct 24 13:51:21.352665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 513/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:21 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:21.423877 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-41cc800b-9296-453c-97a0-17bb8bc9e177 req-18262507-1c1b-4650-880a-c211ebe9ef0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cda293-d706-482f-acba-625c087884e9", "tag": "1ed5217e-752e-4e33-a295-fe9ba63194d4"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:21.434446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-41cc800b-9296-453c-97a0-17bb8bc9e177 req-18262507-1c1b-4650-880a-c211ebe9ef0a service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:21.435352 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-41cc800b-9296-453c-97a0-17bb8bc9e177 req-18262507-1c1b-4650-880a-c211ebe9ef0a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:21.435788 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-41cc800b-9296-453c-97a0-17bb8bc9e177 req-18262507-1c1b-4650-880a-c211ebe9ef0a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:21.447712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-41cc800b-9296-453c-97a0-17bb8bc9e177 req-18262507-1c1b-4650-880a-c211ebe9ef0a service nova] Creating event network-changed:1ed5217e-752e-4e33-a295-fe9ba63194d4 for instance 96cda293-d706-482f-acba-625c087884e9 on hv-cinder-86249 Oct 24 13:51:21.452488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-41cc800b-9296-453c-97a0-17bb8bc9e177 req-18262507-1c1b-4650-880a-c211ebe9ef0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Oct 24 13:51:21.453074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 515/1028] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:22.374478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:22.375123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:22.381508 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:22.381994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:22.382545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:22.383575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:22.384032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:22.384456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:22.516534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:22.524852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-538160c8-664e-4fcd-9162-794f41f4a6e7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.154315 Oct 24 13:51:22.525407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 514/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:22 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:23.549245 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:23.549863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:23.556081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:23.556559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:23.556992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:23.557679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:23.558132 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:23.558575 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:23.685036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:23.692612 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6c389d18-5011-4a75-9b4b-736d26a7e5dc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.148183 Oct 24 13:51:23.693169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 516/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:23 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:24.716001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:24.716613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:24.722986 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:24.723468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:24.723903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:24.724589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:24.725040 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:24.725459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:24.854269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:24.861873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2ee6a12a-156d-44ac-ba46-8e59963abd61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.149718 Oct 24 13:51:24.862461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 515/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:24 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:25.885516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:25.886124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:25.892191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:25.892664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:25.893092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:25.893775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:25.894247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:25.894669 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:26.022934 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:26.031454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2559a91b-63e8-4142-97dc-f53ea11f941f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.150374 Oct 24 13:51:26.032008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 517/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:25 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:27.054152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:27.054787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:27.061548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:27.062027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:27.062493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:27.063179 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:27.063631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:27.064052 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:27.198197 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:27.205987 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-31375100-4931-470a-b0be-b7a8d9134da5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.155624 Oct 24 13:51:27.206589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 516/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:27 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:28.229369 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:28.229984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:28.236392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:28.236869 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:28.237302 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:28.237984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:28.238464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:28.238883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:28.371872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:28.379527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-29c9a0af-2709-4ea2-b311-5723092ad0f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.154576 Oct 24 13:51:28.380083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 518/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:28 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:29.402071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:29.402752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:29.405824 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:29.411429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:29.411907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:29.412336 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:29.413019 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:29.413467 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:29.413884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:29.545574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:29.553307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-70be456c-bf6e-4308-92af-51f5b48013e0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.155357 Oct 24 13:51:29.553876 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 517/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:29 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:30.575829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:30.576441 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:30.578430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:30.579086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:30.585282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:30.585762 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:30.586216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:30.587582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:30.588038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:30.588465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:30.720827 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:30.729246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-99dacf28-31e6-4d09-9181-9312dcf70c8c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.157325 Oct 24 13:51:30.729876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 519/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:30 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:31.419588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:31.420181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:31.426783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:31.427268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:31.427765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:31.428632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:31.429112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:31.429530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:31.453213 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e19bbf48-6edf-47c2-a6ad-953eb97a8a67 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/ips" status: 200 len: 152 microversion: 2.20 time: 0.037606 Oct 24 13:51:31.453773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 518/1037] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Oct 24 13:51:31 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:51:31.753281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:31.754068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:31.761076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:31.761604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:31.762032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:31.762757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:31.763245 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:31.763667 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:31.895853 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:31.903540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-703a2261-5b51-4e1a-a31c-a55c92c6af70 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.155091 Oct 24 13:51:31.904094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 520/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:31 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:32.413132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-fb07ce07-316e-4519-a2d7-1d598583a5a5 req-4e8900c8-572f-42af-8933-cecb1f5566c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cda293-d706-482f-acba-625c087884e9", "name": "network-vif-plugged", "status": "completed", "tag": "1ed5217e-752e-4e33-a295-fe9ba63194d4"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:32.424534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-fb07ce07-316e-4519-a2d7-1d598583a5a5 req-4e8900c8-572f-42af-8933-cecb1f5566c5 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:32.425200 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-fb07ce07-316e-4519-a2d7-1d598583a5a5 req-4e8900c8-572f-42af-8933-cecb1f5566c5 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:32.426273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-fb07ce07-316e-4519-a2d7-1d598583a5a5 req-4e8900c8-572f-42af-8933-cecb1f5566c5 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:32.437778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-fb07ce07-316e-4519-a2d7-1d598583a5a5 req-4e8900c8-572f-42af-8933-cecb1f5566c5 service nova] Creating event network-vif-plugged:1ed5217e-752e-4e33-a295-fe9ba63194d4 for instance 96cda293-d706-482f-acba-625c087884e9 on hv-cinder-86249 Oct 24 13:51:32.442881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-fb07ce07-316e-4519-a2d7-1d598583a5a5 req-4e8900c8-572f-42af-8933-cecb1f5566c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Oct 24 13:51:32.443465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 519/1039] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:51:32.926487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:32.927095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:32.934236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:32.934710 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:32.935136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:32.935814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:32.936261 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:32.936678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:33.071563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:33.079255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4aa41dba-f143-435a-a223-e6967160511f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.156596 Oct 24 13:51:33.079813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 521/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:32 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:33.291666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:33.292213 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:33.298372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:33.298856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:33.299290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:33.299975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:33.300426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:33.300844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:33.323525 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lazy-loading 'flavor' on Instance uuid 41012da5-d2a4-4917-9415-3dfc4b40744c {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:51:33.507903 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-819a9da8-189d-4ca0-b484-03ba95d42f4a tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/action" status: 202 len: 0 microversion: 2.20 time: 0.220873 Oct 24 13:51:33.508640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 520/1041] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 24 13:51:33 2022] POST /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:51:33.516791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:33.517430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:33.523392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:33.523865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:33.524559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:33.525320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:33.525772 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:33.526208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:33.652071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:33.660290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:33.661769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:33.662949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d8210a33-529b-45b8-a60e-4cecc7dc5bf7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.150046 Oct 24 13:51:33.663497 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 522/1042] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:33 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:34.103110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:34.103821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:34.110942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:34.111427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:34.111864 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:34.112562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:34.113018 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:34.113444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:34.245791 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:34.253510 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-78d91bf2-7078-4d05-9286-d0bc45ae7208 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1266 microversion: 2.1 time: 0.154678 Oct 24 13:51:34.254260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 521/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:34 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:34.690918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:34.691523 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:34.697861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:34.698381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:34.698955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:34.699683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:34.700131 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:34.700547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:34.830876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:34.838784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:34.840253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:34.841401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-13f67f98-83af-4106-80ed-dd2c41e340e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.154455 Oct 24 13:51:34.841951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 523/1044] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:34 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:34.904269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:34.904824 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:34.911442 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:34.911920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:34.912353 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:34.913040 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:34.913487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:34.913906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:34.936797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8e7b2a43-c7fe-47c5-b738-2ea3686df217 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/ips" status: 200 len: 147 microversion: 2.1 time: 0.036466 Oct 24 13:51:34.937346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 522/1045] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:51:34 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:35.276880 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:35.277599 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:35.283682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:35.284181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:35.284615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:35.285409 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:35.285954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:35.286434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:35.414697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:35.423058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f01882ad-ffc5-4919-a159-5625a1aeb32d tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1453 microversion: 2.1 time: 0.150050 Oct 24 13:51:35.423618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 524/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:35 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:35.445822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:35.446402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:35.452631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:35.453109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:35.453537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:35.454241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:35.454694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:35.455114 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:35.586625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:35.594955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ac4b4989-4ab7-4811-8e4c-648f09c2c9d2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1453 microversion: 2.1 time: 0.153113 Oct 24 13:51:35.595892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 523/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:35 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:51:35.868081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:35.868703 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:35.875148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:35.875621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:35.876054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:35.876734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:35.877179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:35.877596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:36.017949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:36.026052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:36.028089 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:36.029256 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-420cd6bb-d71c-495c-aa56-3ca04ea73fc1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.165105 Oct 24 13:51:36.029817 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 525/1048] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:35 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:36.264933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a20b67cc-7709-4783-b52b-201c214adf3d"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:36.267473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:36.273943 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:36.274556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:36.275053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:36.275815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:36.276264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:36.276684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:36.516302 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9c91d1a7-44ae-445d-a7ff-7a4aa5fce395 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256294 Oct 24 13:51:36.522657 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 524/1049] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:51:36 2022] POST /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:37.055243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:37.055863 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:37.062988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:37.063475 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:37.063911 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:37.064644 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:37.065100 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:37.065525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:37.207162 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:37.216141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:37.217628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:37.218830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-73f487d7-71a6-48ca-922b-fe70e4dfc7bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.167555 Oct 24 13:51:37.219385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 526/1050] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:37 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:37.308819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-288db0b5-7d27-4bc7-bbac-a20fe690cc4e req-1d59d8f9-14b1-47b2-97ff-436a3be79d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cda293-d706-482f-acba-625c087884e9", "tag": "1ed5217e-752e-4e33-a295-fe9ba63194d4"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:37.318383 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-288db0b5-7d27-4bc7-bbac-a20fe690cc4e req-1d59d8f9-14b1-47b2-97ff-436a3be79d12 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:37.319061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-288db0b5-7d27-4bc7-bbac-a20fe690cc4e req-1d59d8f9-14b1-47b2-97ff-436a3be79d12 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:37.319490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-288db0b5-7d27-4bc7-bbac-a20fe690cc4e req-1d59d8f9-14b1-47b2-97ff-436a3be79d12 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:37.331318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-288db0b5-7d27-4bc7-bbac-a20fe690cc4e req-1d59d8f9-14b1-47b2-97ff-436a3be79d12 service nova] Creating event network-changed:1ed5217e-752e-4e33-a295-fe9ba63194d4 for instance 96cda293-d706-482f-acba-625c087884e9 on hv-cinder-86249 Oct 24 13:51:37.336080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-288db0b5-7d27-4bc7-bbac-a20fe690cc4e req-1d59d8f9-14b1-47b2-97ff-436a3be79d12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032815 Oct 24 13:51:37.336667 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 525/1051] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:38.244878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:38.246208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:38.252952 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:38.253427 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:38.253857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:38.254574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:38.255025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:38.255443 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:38.388314 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:38.396427 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:38.397865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:38.399077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c2eab10e-04ab-4493-b973-df252f9d5465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.158126 Oct 24 13:51:38.399629 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 527/1052] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:38 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:39.425794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:39.426511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:39.432575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:39.433592 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:39.434027 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:39.434831 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:39.435276 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:39.435693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:39.564062 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:39.571962 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:39.573384 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:39.575149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-11b841ed-a517-433d-8101-d5af3835f269 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.154190 Oct 24 13:51:39.575698 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 526/1053] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:39 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:40.600463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:40.601102 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:40.608355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:40.608834 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:40.609269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:40.609984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:40.610489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:40.610913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:40.737825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:40.747099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:40.748540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:40.749721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5d3c1edd-0726-49b2-9b89-f8da635b39fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.153256 Oct 24 13:51:40.750290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 528/1054] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:40 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:41.775585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:41.776204 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:41.782876 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:41.783355 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:41.783786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:41.784481 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:41.784914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:41.785333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:41.918742 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:41.926740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:41.928178 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:41.929328 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-87a2921b-0bae-44d8-ac78-62f8feb0a3a9 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.157697 Oct 24 13:51:41.929884 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 527/1055] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:41 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:42.957200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:42.957808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:42.965727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:42.966233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:42.966830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:42.967601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:42.967975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:42.968391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:43.105386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:43.113787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:43.115328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:43.116491 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-167a2157-1d9b-4621-9862-13eb3b7f1699 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.164434 Oct 24 13:51:43.117047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 529/1056] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:42 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:51:44.075263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:44.077428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:44.083976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:44.084459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:44.084901 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:44.085594 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:44.086051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:44.086509 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:44.090268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:44.117999 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6366bacc-f62c-4581-9838-52658e0b17e6 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047500 Oct 24 13:51:44.118586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 528/1057] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:51:44 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:44.129983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:44.130632 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:44.137045 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:44.137540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:44.137956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:44.138678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:44.139208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:44.139559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:44.142792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:44.143401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:44.149238 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:44.149714 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:44.150137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:44.150839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:44.151286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:44.151739 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:44.165647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:44.171251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ba5a7edf-04ac-4d54-8d1a-b503a2059055 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/a20b67cc-7709-4783-b52b-201c214adf3d" status: 200 len: 194 microversion: 2.1 time: 0.045084 Oct 24 13:51:44.171851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 530/1058] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 24 13:51:44 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/a20b67cc-7709-4783-b52b-201c214adf3d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:44.285691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:44.295743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:44.297214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:44.298429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fe8be9b7-3ad5-42a9-a4d8-357fbfd9b955 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.159425 Oct 24 13:51:44.299011 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 529/1059] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:44 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:51:45.325586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:45.326219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:45.332696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:45.333170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:45.333601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:45.334309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:45.334779 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:45.335190 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:45.517800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:45.519822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c85754a-c302-4845-86d2-2b247bdccc6d"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:45.522247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:45.526010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:45.528611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:45.529388 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:45.529770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-349f3cfe-cd85-425d-8e72-f4c4162a1212 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1746 microversion: 2.20 time: 0.208246 Oct 24 13:51:45.529878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:45.530568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:45.530700 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 531/1060] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:45 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:45.531349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:45.531880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:45.532305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:45.768415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-eeaa6aec-f1fb-4017-9dcd-2742d571d57a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "POST /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252356 Oct 24 13:51:45.769057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 530/1061] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:51:45 2022] POST /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:51:46.556378 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:46.556988 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:46.564124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:46.564603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:46.565044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:46.565739 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:46.566219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:46.566645 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:46.704513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:46.712555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:46.714047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:46.715247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-440146ba-a5d5-4f40-8071-ec5b05bd8828 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1746 microversion: 2.20 time: 0.162766 Oct 24 13:51:46.715803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 532/1062] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:46 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:47.741358 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:47.742085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:47.748984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:47.749469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:47.749910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:47.750774 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:47.751234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:47.751665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:47.936812 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:47.944885 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:47.946339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:47.947484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-5af30ae5-3d73-43fb-bbe8-2717f5103da7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1746 microversion: 2.20 time: 0.210978 Oct 24 13:51:47.948023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 531/1063] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:47 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1746 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:48.479580 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-ccbdcb7d-eabe-4e7e-92c5-2c14dc07f9e7 req-4ebdcbdd-a1fe-4f10-9546-7e54a8b4781c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "name": "network-vif-plugged", "status": "completed", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:51:48.485548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:48.490961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ccbdcb7d-eabe-4e7e-92c5-2c14dc07f9e7 req-4ebdcbdd-a1fe-4f10-9546-7e54a8b4781c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:48.491444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ccbdcb7d-eabe-4e7e-92c5-2c14dc07f9e7 req-4ebdcbdd-a1fe-4f10-9546-7e54a8b4781c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:48.491876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ccbdcb7d-eabe-4e7e-92c5-2c14dc07f9e7 req-4ebdcbdd-a1fe-4f10-9546-7e54a8b4781c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:48.503822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-ccbdcb7d-eabe-4e7e-92c5-2c14dc07f9e7 req-4ebdcbdd-a1fe-4f10-9546-7e54a8b4781c service nova] Creating event network-vif-plugged:21d722a6-32b9-4783-87d2-18e99bef65f0 for instance 41012da5-d2a4-4917-9415-3dfc4b40744c on hv-cinder-86249 Oct 24 13:51:48.508778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-ccbdcb7d-eabe-4e7e-92c5-2c14dc07f9e7 req-4ebdcbdd-a1fe-4f10-9546-7e54a8b4781c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Oct 24 13:51:48.509391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 533/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:48.972790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:48.973555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:48.976994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=43 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:48.981198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:48.981683 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:48.982116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:48.982833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:48.983278 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:48.983696 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:49.112068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:49.120053 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:49.122406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:49.123571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2e871c5c-47ec-4761-99f6-147d1a146e45 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1746 microversion: 2.20 time: 0.154719 Oct 24 13:51:49.124157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 532/1065] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:48 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:50.150499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:50.151204 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:50.158571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:50.159051 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:50.159487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:50.160175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:50.160628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:50.161053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:50.296335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:50.304408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:50.305889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:50.307057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a908d968-a357-4f32-938e-96e23155ee72 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1746 microversion: 2.20 time: 0.161376 Oct 24 13:51:50.307607 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 534/1066] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:50 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:51.332839 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:51.333484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:51.340581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:51.341059 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:51.341496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:51.342204 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:51.342663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:51.343086 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:51.473990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:51.483269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:51.484718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:51.485877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e0a9149b-0323-44a4-8c88-3e7a0f397857 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1746 microversion: 2.20 time: 0.157060 Oct 24 13:51:51.486474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 533/1067] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:51 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:52.512042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:52.513499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:52.520092 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:52.520572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:52.521006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:52.521705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:52.522155 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:52.522605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:52.653781 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:52.663275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:52.664723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:52.665889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-99b144ca-0438-4c69-9cac-8ae59f2f72bd tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.157764 Oct 24 13:51:52.666468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 535/1068] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:52 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:53.327721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:53.329965 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:53.337153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.337607 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.338042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.338850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.339211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.339650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.373335 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-33b208a4-3eb1-4ca3-b6fa-bd16d86952fa tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051077 Oct 24 13:51:53.373900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 534/1069] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:51:53 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:53.518710 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:53.519873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:53.526907 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.527386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.528032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.529088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.529548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.529972 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.560961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cc9a8ab2-23ab-486e-b7bf-c6768769ce6b tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/a20b67cc-7709-4783-b52b-201c214adf3d" status: 200 len: 194 microversion: 2.1 time: 0.046041 Oct 24 13:51:53.561805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 536/1070] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 24 13:51:53 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/a20b67cc-7709-4783-b52b-201c214adf3d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:53.572933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:53.573844 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:53.581055 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.581836 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.582299 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.583227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.583981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.584470 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.669644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lazy-loading 'services' on Instance uuid 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:51:53.694141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:53.694876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:53.701662 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.702201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.702830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.703754 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:53.704366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:53.704949 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:53.756954 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4b7f6394-b662-478a-bc28-42e3de7abac8 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/a20b67cc-7709-4783-b52b-201c214adf3d" status: 202 len: 0 microversion: 2.1 time: 0.187968 Oct 24 13:51:53.757957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 535/1071] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:51:53 2022] DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/a20b67cc-7709-4783-b52b-201c214adf3d => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:51:53.891923 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:53.901785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:53.912956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:53.914499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e6d78218-fdc9-4263-99d8-06a6586ebf3b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.224374 Oct 24 13:51:53.930191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 537/1072] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:53 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:51:54.942705 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:54.943403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:54.955150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:54.955642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:54.956085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:54.956783 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:54.957760 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:54.958838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:55.132452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:55.146973 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:55.148923 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:55.150617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-17f81d20-082a-44b2-8514-3ff440efceab tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.213053 Oct 24 13:51:55.151364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 536/1073] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:54 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:56.001055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:56.001626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:56.007829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:56.008309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:56.008751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:56.009449 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:56.009902 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:56.010360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:56.047820 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6292eab9-f187-4050-a60c-fa531915a9ee tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/0c85754a-c302-4845-86d2-2b247bdccc6d" status: 200 len: 194 microversion: 2.1 time: 0.051449 Oct 24 13:51:56.048655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 538/1074] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 24 13:51:55 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/0c85754a-c302-4845-86d2-2b247bdccc6d => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:51:56.066833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:56.066833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:56.072952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:56.073431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:56.073863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:56.074578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:56.075611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:56.076035 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:56.165614 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lazy-loading 'services' on Instance uuid 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:51:56.176836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:56.177819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:56.186265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:56.187358 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:56.188096 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:56.189591 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:56.190427 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:56.190930 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:56.265402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-26fa28f7-aa89-4175-825c-9e8b0ad22694 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/0c85754a-c302-4845-86d2-2b247bdccc6d" status: 202 len: 0 microversion: 2.1 time: 0.206961 Oct 24 13:51:56.269097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 537/1075] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:51:56 2022] DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments/0c85754a-c302-4845-86d2-2b247bdccc6d => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:51:56.391742 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:56.402540 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:56.404666 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:56.406098 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6582674e-22d0-4ca4-931f-0d2581da55da tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.233147 Oct 24 13:51:56.407125 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 539/1076] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:56 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:51:57.433266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:57.435221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:57.443211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.444399 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.445234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.446117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.446793 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.447381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.490729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:57.496793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:57.504634 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.505593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.507401 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.508267 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.508726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.509150 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.543747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1d731e95-aa78-49af-9eae-38d0b3e8304a tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063083 Oct 24 13:51:57.550489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 540/1077] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:51:57 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 13:51:57.592028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:57.600663 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:57.602410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:57.603823 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3ce24d72-8642-41d6-9f23-9d6eb4114125 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.175112 Oct 24 13:51:57.618666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 538/1078] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:57 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:57.680631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:57.682803 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:57.688823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.689298 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.689728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.690442 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.690891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.691420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.724970 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-80bc366f-24d3-4772-895d-d4c7411d5d8e tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048588 Oct 24 13:51:57.725596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 541/1079] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:51:57 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:51:57.794210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:57.794716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:57.800718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.801199 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.801630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.802357 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.803136 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.804361 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.832448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:51:57.913533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-37cdeb40-1f8b-4713-88b7-3b28cab433c1 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 204 len: 0 microversion: 2.1 time: 0.124829 Oct 24 13:51:57.915740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 539/1080] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:51:57 2022] DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:51:57.924442 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:57.925057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:57.932367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.932860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.933331 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:57.934036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:57.934557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:57.935016 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:58.078755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:58.087278 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f9a58ce2-98ae-475d-9e57-7acf9cf0cf61 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1674 microversion: 2.1 time: 0.167299 Oct 24 13:51:58.088122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 542/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:57 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:51:58.630933 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:58.631642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:58.638397 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:58.638906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:58.639356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:58.640064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:58.640544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:58.641177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:58.661552 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:51:58.791283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:58.801198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:58.802710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:58.803872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-14da555e-a9c5-4a16-8391-b4353c1a4ffb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.177227 Oct 24 13:51:58.804913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 540/1082] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:58 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:51:59.112524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:59.113430 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:59.120431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:59.121181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:59.121921 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:59.122931 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:59.123586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:59.124726 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:59.282410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:51:59.292892 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3cb898f8-1ae0-4c05-93ba-857e6e308cf7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1674 microversion: 2.1 time: 0.184530 Oct 24 13:51:59.293829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 543/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:51:59 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:51:59.831768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:51:59.833628 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:51:59.842643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:59.843131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:59.843556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:59.844424 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:51:59.844874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:51:59.845346 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:51:59.993147 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:00.006707 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:00.008146 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:00.009296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-18cab34b-8116-4467-b29b-eb13a0f37af1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.182971 Oct 24 13:52:00.009842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 541/1084] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:51:59 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:52:00.317823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:00.318604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:00.328603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:00.330270 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:00.331032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:00.333342 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:00.333977 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:00.334664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:00.510701 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:00.522223 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-20c5d7fe-5da6-4ac9-bde5-28a9c168c363 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1674 microversion: 2.1 time: 0.209383 Oct 24 13:52:00.526550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 544/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:00 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:52:01.039390 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:01.040761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:01.051126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:01.051787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:01.054802 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:01.055656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:01.056251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:01.056833 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:01.363338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:01.377753 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:01.384047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:01.385412 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d0aeab63-5916-4db3-bfb5-abb29e8dae15 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.353738 Oct 24 13:52:01.386012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 542/1086] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:01 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:01.550524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:01.551136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:01.571328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:01.576470 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:01.578326 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:01.582014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:01.582751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:01.586926 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:01.695252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-f099ab78-11a7-4892-aac2-9a08cb4875c9 req-bc63ead2-9619-4c40-92fe-a2bde67e9ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e", "name": "network-vif-deleted", "tag": "4788cb10-6434-4341-ba33-145ca730f9c7"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:01.714017 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea8feefb0614972898c1b1ad28077a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f08e43a5984a9398b3d5ec41e4282c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:01.725050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-318e28ca-e2b3-4dbc-a1be-8f3fa6108c4f tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 200 len: 1606 microversion: 2.1 time: 0.178635 Oct 24 13:52:01.725889 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f099ab78-11a7-4892-aac2-9a08cb4875c9 req-bc63ead2-9619-4c40-92fe-a2bde67e9ab9 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:01.726064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 545/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:01 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 1606 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:52:01.727511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f099ab78-11a7-4892-aac2-9a08cb4875c9 req-bc63ead2-9619-4c40-92fe-a2bde67e9ab9 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:01.728106 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-f099ab78-11a7-4892-aac2-9a08cb4875c9 req-bc63ead2-9619-4c40-92fe-a2bde67e9ab9 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:01.753395 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-f099ab78-11a7-4892-aac2-9a08cb4875c9 req-bc63ead2-9619-4c40-92fe-a2bde67e9ab9 service nova] Creating event network-vif-deleted:4788cb10-6434-4341-ba33-145ca730f9c7 for instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e on hv-cinder-86249 Oct 24 13:52:01.760630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-f099ab78-11a7-4892-aac2-9a08cb4875c9 req-bc63ead2-9619-4c40-92fe-a2bde67e9ab9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070083 Oct 24 13:52:01.765711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 543/1088] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 13:52:02.415180 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:02.416236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:02.426672 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:02.427160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:02.427597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:02.428301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:02.428787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:02.429238 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:02.749316 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:02.750012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:02.757575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:02.758431 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:02.759680 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:02.760891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:02.761554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:02.762215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] HTTP exception thrown: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Request method failure captured: Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e HTTP/1.1 Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYdRGNdldiJ-8MAIQuemeHtnlAMXCp3Tmlpai2WH51G6MYeOraLI2rIk8Bmrd2eXv0Vs2nQXJ3e7bndmkKFC96dwWQBjV9rFF0sG8PbH-deyFOASuIfKju4go4CnFaevTIgNEaVMPKoCp7T786Qv_75Bj8BtTu0qecwDdycfO6ZXoY Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:02.800621 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1ea8feefb0614972898c1b1ad28077a8 Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:02.802779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e'} Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:02.803588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:02.805009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:02.806462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Returning 404 to user: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:02.806462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-92614492-95a5-452d-a498-b6ca6f3c2537 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 404 len: 111 microversion: 2.1 time: 0.054737 Oct 24 13:52:02.806462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 544/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:02 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:52:02.814746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4713486a-9ba0-47b3-876a-d83bdf3f6cb7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '.version_select at 0x7f8dc2b1ad30>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:02.877918 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4713486a-9ba0-47b3-876a-d83bdf3f6cb7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101169168" status: 202 len: 0 microversion: 2.1 time: 0.067083 Oct 24 13:52:02.879929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 545/1090] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 24 13:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101169168 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:52:02.923219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:02.932868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:02.935139 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:02.936482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-793c4625-ba76-47ad-96db-4647a2958867 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.525658 Oct 24 13:52:02.937455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 546/1091] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:02 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:03.964472 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:03.965078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:03.972896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:03.973337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:03.973788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:03.974515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:03.974967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:03.975386 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:04.114862 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:04.123045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:04.124504 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:04.125665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f0c01dcf-a3a0-4ceb-9512-7d6bf783d6a3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1741 microversion: 2.20 time: 0.165824 Oct 24 13:52:04.126252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 546/1092] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:03 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:05.153571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:05.154542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:05.162213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:05.162707 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:05.163151 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:05.163841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:05.164302 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:05.164765 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:05.296021 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:05.304160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:05.305583 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:05.306849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1afd5977-e7b4-450c-9e1d-45e03dbd04e7 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1723 microversion: 2.20 time: 0.158623 Oct 24 13:52:05.307410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 547/1093] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:05 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:05.920978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:05.921476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:05.927917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:05.928392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:05.928822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:05.929506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:05.929957 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:05.930416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:05.943540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] HTTP exception thrown: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Request method failure captured: Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e HTTP/1.1 Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYdRGNdldiJ-8MAIQuemeHtnlAMXCp3Tmlpai2WH51G6MYeOraLI2rIk8Bmrd2eXv0Vs2nQXJ3e7bndmkKFC96dwWQBjV9rFF0sG8PbH-deyFOASuIfKju4go4CnFaevTIgNEaVMPKoCp7T786Qv_75Bj8BtTu0qecwDdycfO6ZXoY Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:05.945051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1ea8feefb0614972898c1b1ad28077a8 Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.946543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e'} Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:05.947543 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.949071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.951401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Returning 404 to user: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:05.951401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-63db9f1d-bc80-4920-ac85-57a5280c49b7 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 404 len: 111 microversion: 2.1 time: 0.029808 Oct 24 13:52:05.951401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 547/1094] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:05 2022] DELETE /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:05.955788 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:05.956395 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:05.962282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:05.962816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:05.963293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:05.964104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:05.964651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:05.965154 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:05.970496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=100 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:05.980236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] HTTP exception thrown: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Request method failure captured: Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e HTTP/1.1 Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYdRGNdldiJ-8MAIQuemeHtnlAMXCp3Tmlpai2WH51G6MYeOraLI2rIk8Bmrd2eXv0Vs2nQXJ3e7bndmkKFC96dwWQBjV9rFF0sG8PbH-deyFOASuIfKju4go4CnFaevTIgNEaVMPKoCp7T786Qv_75Bj8BtTu0qecwDdycfO6ZXoY Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:05.982502 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1ea8feefb0614972898c1b1ad28077a8 Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.984104 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e'} Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:05.985038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. Oct 24 13:52:05.986633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:05.988022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Returning 404 to user: Instance 1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:05.988022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-36931c5e-84e2-4cda-a6b5-2a83300f79bd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e" status: 404 len: 111 microversion: 2.1 time: 0.031893 Oct 24 13:52:05.988022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 548/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:05 2022] GET /compute/v2.1/servers/1c5cabff-ac8f-4ae0-b3f1-872bfffeea0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:06.333678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:06.334309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:06.340339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:06.341043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:06.341574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:06.342292 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:06.342740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:06.343282 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:06.472699 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:06.480687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:06.482331 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:06.483487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-af838005-f5a9-4960-86fa-15c7489cafd2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1723 microversion: 2.20 time: 0.153933 Oct 24 13:52:06.484054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 548/1096] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:06 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:07.124747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:07.125250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:07.132165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.132648 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.133086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.133786 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.134266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.134696 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.148009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] HTTP exception thrown: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Request method failure captured: Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 HTTP/1.1 Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYdRGNdldiJ-8MAIQuemeHtnlAMXCp3Tmlpai2WH51G6MYeOraLI2rIk8Bmrd2eXv0Vs2nQXJ3e7bndmkKFC96dwWQBjV9rFF0sG8PbH-deyFOASuIfKju4go4CnFaevTIgNEaVMPKoCp7T786Qv_75Bj8BtTu0qecwDdycfO6ZXoY Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:07.149553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1ea8feefb0614972898c1b1ad28077a8 Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.151161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'b4bf2855-1081-401a-a540-af8ef43dc1c8'} Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:07.152046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.154157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.155893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Returning 404 to user: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:07.155893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fa3fb570-69ab-48db-9407-e11dde1aee82 tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 404 len: 111 microversion: 2.1 time: 0.030241 Oct 24 13:52:07.155893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 549/1097] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:07 2022] DELETE /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:07.160012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:07.160629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] [instance: b4bf2855-1081-401a-a540-af8ef43dc1c8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:07.163130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:52:07.163279 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Mon Oct 24 13:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 (ip 10.222.0.20) !!! Oct 24 13:52:07.170708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.171219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.171653 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.172466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.172926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.173351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.187874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] HTTP exception thrown: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Request method failure captured: Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 HTTP/1.1 Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYdRGNdldiJ-8MAIQuemeHtnlAMXCp3Tmlpai2WH51G6MYeOraLI2rIk8Bmrd2eXv0Vs2nQXJ3e7bndmkKFC96dwWQBjV9rFF0sG8PbH-deyFOASuIfKju4go4CnFaevTIgNEaVMPKoCp7T786Qv_75Bj8BtTu0qecwDdycfO6ZXoY Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:07.189421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e0f08e43a5984a9398b3d5ec41e4282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: e0f08e43a5984a9398b3d5ec41e4282c Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-266309466 Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1ea8feefb0614972898c1b1ad28077a8 Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeTestJSON-266309466-project Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.191088 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'b4bf2855-1081-401a-a540-af8ef43dc1c8'} Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:07.191992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. Oct 24 13:52:07.193533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:07.194924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] Returning 404 to user: Instance b4bf2855-1081-401a-a540-af8ef43dc1c8 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:07.194924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fd3a91b4-c6cb-4cea-9df5-d784e934f9cd tempest-AttachVolumeTestJSON-266309466 tempest-AttachVolumeTestJSON-266309466-project] 10.222.0.20 "GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8" status: 404 len: 111 microversion: 2.1 time: 0.034689 Oct 24 13:52:07.194924 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 549/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:07 2022] GET /compute/v2.1/servers/b4bf2855-1081-401a-a540-af8ef43dc1c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:07.509025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:07.509660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:07.516324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.516899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.517338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.518142 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.518627 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.519052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.650375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:07.659536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:07.660974 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:07.662137 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-5439cafa-06cc-4759-8b91-61509d15b87b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1666 microversion: 2.20 time: 0.157205 Oct 24 13:52:07.662716 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 550/1099] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:07 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:07.687453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b94ba2ba-a467-4e78-8dfa-9cfe2f9e5c9c"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:07.689909 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:07.696260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.696749 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.697189 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.697891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:07.698394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:07.699046 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:07.981813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ddbcee5b-9ad6-42f2-9ae4-6e7ded5dc820 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298537 Oct 24 13:52:07.982578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 550/1100] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 24 13:52:07 2022] POST /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:52:08.113235 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:08.113763 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:08.119721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.120206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.120643 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.121337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.122504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.123037 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.392176 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a40c0082-28dd-4434-a429-8af336213d8b tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-volume_attachments/b94ba2ba-a467-4e78-8dfa-9cfe2f9e5c9c" status: 202 len: 0 microversion: 2.20 time: 0.282763 Oct 24 13:52:08.393904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 551/1101] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 24 13:52:08 2022] DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-volume_attachments/b94ba2ba-a467-4e78-8dfa-9cfe2f9e5c9c => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:52:08.463202 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:08.463801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:08.471907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.472428 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.473071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.473782 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.474347 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.474800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.505295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125456) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:52:08.577288 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-32a898d7-784d-4c3f-9280-71e8100ee49c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "POST /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/action" status: 202 len: 0 microversion: 2.20 time: 0.118176 Oct 24 13:52:08.578451 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 551/1102] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 24 13:52:08 2022] POST /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:52:08.592091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:08.593105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:08.600165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.600664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.601108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.602000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.602544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.603841 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.754678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-5d300c4e-aa5c-44f0-aa83-a0405e9f1fbd req-c761e328-49e1-468e-846f-191a8960fb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "name": "network-vif-unplugged", "status": "completed", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:08.772562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-5d300c4e-aa5c-44f0-aa83-a0405e9f1fbd req-c761e328-49e1-468e-846f-191a8960fb0b service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:08.773452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-5d300c4e-aa5c-44f0-aa83-a0405e9f1fbd req-c761e328-49e1-468e-846f-191a8960fb0b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:08.774311 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-5d300c4e-aa5c-44f0-aa83-a0405e9f1fbd req-c761e328-49e1-468e-846f-191a8960fb0b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:08.783864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:08.792128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.compute.server_external_events [req-5d300c4e-aa5c-44f0-aa83-a0405e9f1fbd req-c761e328-49e1-468e-846f-191a8960fb0b service nova] Unable to find a host for instance 41012da5-d2a4-4917-9415-3dfc4b40744c. Dropping event network-vif-unplugged {{(pid=125456) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 13:52:08.794281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-5d300c4e-aa5c-44f0-aa83-a0405e9f1fbd req-c761e328-49e1-468e-846f-191a8960fb0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046167 Oct 24 13:52:08.796113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 552/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 24 13:52:08.800842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:08.802463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:08.803934 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c15729cf-20af-4184-b7d4-5589c3424443 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1674 microversion: 2.20 time: 0.221390 Oct 24 13:52:08.805018 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 552/1104] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:08 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:09.831351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:09.831975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:09.839061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:09.839546 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:09.839986 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:09.840719 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:09.841177 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:09.841609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:09.978324 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:09.990905 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:09.992598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:09.993992 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b61d0eac-84e4-4abe-aee8-08675831cb01 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.166759 Oct 24 13:52:09.994575 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 553/1105] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:09 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:11.022830 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:11.024065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:11.041247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:11.041751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:11.042241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:11.042961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:11.043422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:11.044551 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:11.213577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:11.221996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:11.223459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:11.224621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b86c1a5f-781c-484e-9075-a8081b6ee8fc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.206954 Oct 24 13:52:11.225179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 553/1106] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:11 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:12.250892 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6b589c76-b8cd-4c18-b3f8-7f7a07169ad8 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Action: 'create', calling method: .version_select at 0x7f8dc23d5280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1343644358", "metadata": {"Type": "work"}}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:12.254270 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:12.254947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:12.263236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:12.263732 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:12.264183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:12.264893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:12.265344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:12.265767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6b589c76-b8cd-4c18-b3f8-7f7a07169ad8 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Request method failure captured: Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 122 Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpiM0PkIvj6VuUWC25yWnlA6JxsW1U1d3HmM-gJ6T_iJch0yYo3PcrIHy-zY7VbP_nPFlZNovGlGWthg2p-VkiwqXKdIsJxEx9gVCeqgvpSnpsd5rcxajJ48Va7Uyz0PuCvK8VH6dhBItmJhcjOqeHbEK58kRH3Bu1zw16TDsNmB22Q Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:12.276295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a8822df10c6401c8d35d552984330fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: c424209448834b2aac0a112c8ef17197 Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1343644358", "metadata": {"Type": "work"}}} Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:52:12.278375 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1343644358', 'metadata': {'Type': 'work'}}}} Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi '#$%' Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:12.279568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:52:12.284037 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:52:12.286078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:52:12.286078 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.288585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6b589c76-b8cd-4c18-b3f8-7f7a07169ad8 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:12.291506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6b589c76-b8cd-4c18-b3f8-7f7a07169ad8 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.189618 Oct 24 13:52:12.292713 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 554/1107] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 24 13:52:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:52:12.303816 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2fe1de9c-1a0b-4a37-b2ea-bc98a69e1872 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Action: 'create', calling method: .version_select at 0x7f8dc6014e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1992475206", "metadata": {"Type": "work"}}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2fe1de9c-1a0b-4a37-b2ea-bc98a69e1872 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Request method failure captured: Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 120 Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpiM0PkIvj6VuUWC25yWnlA6JxsW1U1d3HmM-gJ6T_iJch0yYo3PcrIHy-zY7VbP_nPFlZNovGlGWthg2p-VkiwqXKdIsJxEx9gVCeqgvpSnpsd5rcxajJ48Va7Uyz0PuCvK8VH6dhBItmJhcjOqeHbEK58kRH3Bu1zw16TDsNmB22Q Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:12.310400 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a8822df10c6401c8d35d552984330fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: c424209448834b2aac0a112c8ef17197 Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1992475206", "metadata": {"Type": "work"}}} Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:52:12.312101 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1992475206', 'metadata': {'Type': 'work'}}}} Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi '0' Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:12.313121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:52:12.314821 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:52:12.316259 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:52:12.316259 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.317268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2fe1de9c-1a0b-4a37-b2ea-bc98a69e1872 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:12.318693 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2fe1de9c-1a0b-4a37-b2ea-bc98a69e1872 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018827 Oct 24 13:52:12.319445 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 555/1108] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 24 13:52:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:52:12.331599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5e0a06f-00e6-4974-8a03-629e610dcbac tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Action: 'create', calling method: .version_select at 0x7f8dc2449b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-242720417", "metadata": {"Type": "work"}}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5e0a06f-00e6-4974-8a03-629e610dcbac tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Request method failure captured: Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 118 Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpiM0PkIvj6VuUWC25yWnlA6JxsW1U1d3HmM-gJ6T_iJch0yYo3PcrIHy-zY7VbP_nPFlZNovGlGWthg2p-VkiwqXKdIsJxEx9gVCeqgvpSnpsd5rcxajJ48Va7Uyz0PuCvK8VH6dhBItmJhcjOqeHbEK58kRH3Bu1zw16TDsNmB22Q Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:12.338248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a8822df10c6401c8d35d552984330fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: c424209448834b2aac0a112c8ef17197 Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-242720417", "metadata": {"Type": "work"}}} Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:52:12.339651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-242720417', 'metadata': {'Type': 'work'}}}} Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi '' Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:12.340557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:52:12.341887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:52:12.343071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:52:12.343071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.347141 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d5e0a06f-00e6-4974-8a03-629e610dcbac tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:12.348112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d5e0a06f-00e6-4974-8a03-629e610dcbac tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020373 Oct 24 13:52:12.348976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 556/1109] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 24 13:52:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:52:12.357639 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6ce3573a-9ba6-473c-95e2-550cfa0b9c61 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Calling method '.version_select at 0x7f8dc29f8f70>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:12.393917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-6ce3573a-9ba6-473c-95e2-550cfa0b9c61 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] HTTP exception thrown: Volume tempest-invalid-442315720 could not be found. Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6ce3573a-9ba6-473c-95e2-550cfa0b9c61 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Request method failure captured: Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-442315720 HTTP/1.1 Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpiM0PkIvj6VuUWC25yWnlA6JxsW1U1d3HmM-gJ6T_iJch0yYo3PcrIHy-zY7VbP_nPFlZNovGlGWthg2p-VkiwqXKdIsJxEx9gVCeqgvpSnpsd5rcxajJ48Va7Uyz0PuCvK8VH6dhBItmJhcjOqeHbEK58kRH3Bu1zw16TDsNmB22Q Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:12.396142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a8822df10c6401c8d35d552984330fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: c424209448834b2aac0a112c8ef17197 Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Volume tempest-invalid-442315720 could not be found. Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'tempest-invalid-442315720'} Oct 24 13:52:12.397851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-442315720 could not be found. (HTTP 404) (Request-ID: req-f344f85b-3eae-4ab9-8b16-b535ca293bb2) Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.398888 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:52:12.400345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-442315720 could not be found. Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:12.401755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-442315720 could not be found. Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-442315720 could not be found. Oct 24 13:52:12.403317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.406215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6ce3573a-9ba6-473c-95e2-550cfa0b9c61 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Returning 404 to user: Volume tempest-invalid-442315720 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:12.406215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6ce3573a-9ba6-473c-95e2-550cfa0b9c61 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-442315720" status: 404 len: 98 microversion: 2.1 time: 0.051749 Oct 24 13:52:12.410568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 557/1110] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Oct 24 13:52:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-442315720 => generated 98 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:52:12.415279 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-af01feee-c4ab-41d3-892f-8756f92b5ca3 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003654 Oct 24 13:52:12.416008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 558/1111] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 24 13:52:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 13:52:12.425167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1543dd98-bf1e-4909-82fb-d26c5f021195 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003608 Oct 24 13:52:12.425672 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 559/1112] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 24 13:52:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 13:52:12.435096 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6605fa1a-e014-4cbb-851b-bc4a3c89692a tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Calling method '.version_select at 0x7f8dc23d5550>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:12.453435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:12.469182 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-6605fa1a-e014-4cbb-851b-bc4a3c89692a tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] HTTP exception thrown: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. Oct 24 13:52:12.471308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6605fa1a-e014-4cbb-851b-bc4a3c89692a tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Request method failure captured: Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: DELETE /compute/v2.1/os-volumes/d533fa0c-ac00-4288-97bb-69bc97821636 HTTP/1.1 Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpiM0PkIvj6VuUWC25yWnlA6JxsW1U1d3HmM-gJ6T_iJch0yYo3PcrIHy-zY7VbP_nPFlZNovGlGWthg2p-VkiwqXKdIsJxEx9gVCeqgvpSnpsd5rcxajJ48Va7Uyz0PuCvK8VH6dhBItmJhcjOqeHbEK58kRH3Bu1zw16TDsNmB22Q Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:12.471613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a8822df10c6401c8d35d552984330fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: c424209448834b2aac0a112c8ef17197 Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'd533fa0c-ac00-4288-97bb-69bc97821636'} Oct 24 13:52:12.473421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. (HTTP 404) (Request-ID: req-bee3796f-dcec-42be-b764-14db5051ca8e) Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.474505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:52:12.475914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:52:12.478679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6605fa1a-e014-4cbb-851b-bc4a3c89692a tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Returning 404 to user: Volume d533fa0c-ac00-4288-97bb-69bc97821636 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6605fa1a-e014-4cbb-851b-bc4a3c89692a tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d533fa0c-ac00-4288-97bb-69bc97821636" status: 404 len: 109 microversion: 2.1 time: 0.042597 Oct 24 13:52:12.480103 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 560/1113] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:52:12 2022] DELETE /compute/v2.1/os-volumes/d533fa0c-ac00-4288-97bb-69bc97821636 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:52:12.481225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:12.483051 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e86fdd9a-3155-4eda-925b-6289cb605a48 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.231591 Oct 24 13:52:12.483414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 554/1114] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:12 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:12.491574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b5a9b643-7411-4a83-8c3e-a84088ee4f93 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Calling method '.version_select at 0x7f8dc2a20b80>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:12.523624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-b5a9b643-7411-4a83-8c3e-a84088ee4f93 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] HTTP exception thrown: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b5a9b643-7411-4a83-8c3e-a84088ee4f93 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Request method failure captured: Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/os-volumes/50919681-00d6-4ad5-991c-4df598396354 HTTP/1.1 Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpiM0PkIvj6VuUWC25yWnlA6JxsW1U1d3HmM-gJ6T_iJch0yYo3PcrIHy-zY7VbP_nPFlZNovGlGWthg2p-VkiwqXKdIsJxEx9gVCeqgvpSnpsd5rcxajJ48Va7Uyz0PuCvK8VH6dhBItmJhcjOqeHbEK58kRH3Bu1zw16TDsNmB22Q Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:12.525642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a8822df10c6401c8d35d552984330fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a8822df10c6401c8d35d552984330fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 0a8822df10c6401c8d35d552984330fc Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-954054067 Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: c424209448834b2aac0a112c8ef17197 Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-954054067-project Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '50919681-00d6-4ad5-991c-4df598396354'} Oct 24 13:52:12.527401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. (HTTP 404) (Request-ID: req-9c1fbe7d-b1b7-45ea-917d-6da033361453) Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.528851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:52:12.530715 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:52:12.532118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b5a9b643-7411-4a83-8c3e-a84088ee4f93 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] Returning 404 to user: Volume 50919681-00d6-4ad5-991c-4df598396354 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b5a9b643-7411-4a83-8c3e-a84088ee4f93 tempest-VolumesNegativeTest-954054067 tempest-VolumesNegativeTest-954054067-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/50919681-00d6-4ad5-991c-4df598396354" status: 404 len: 109 microversion: 2.1 time: 0.044291 Oct 24 13:52:12.533547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 561/1115] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 24 13:52:12 2022] GET /compute/v2.1/os-volumes/50919681-00d6-4ad5-991c-4df598396354 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:52:13.515946 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:13.517898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:13.527046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:13.528515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:13.529426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:13.530665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:13.531279 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:13.531705 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:13.678590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:13.691126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:13.693920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:13.695247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b4e66b6b-2a84-4cb8-b070-e5de52497050 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.187526 Oct 24 13:52:13.695985 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 555/1116] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:13 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:14.722063 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:14.723497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:14.735910 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:14.736662 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:14.737814 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:14.738847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:14.740152 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:14.740817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:14.910872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:14.919415 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:14.920866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:14.922036 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c27aedaa-ee03-4207-874f-229ed49fd3ed tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.204221 Oct 24 13:52:14.922630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 562/1117] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:14 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:15.951417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:15.952192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:15.964494 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:15.965182 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:15.966964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:15.968130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:15.968812 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:15.969463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:16.220747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:16.234074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:16.235908 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:16.237139 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-93955add-01b1-4a5b-907b-e73412bde28f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.290328 Oct 24 13:52:16.237984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 556/1118] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:15 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:17.264196 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:17.264913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:17.272354 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:17.273260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:17.273777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:17.274942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:17.275757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:17.276395 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:17.517232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:17.526624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:17.528912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:17.530738 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d4be74e8-b7b6-4c55-950f-b0987bc3a465 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.270379 Oct 24 13:52:17.531805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 563/1119] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:17 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:18.560106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:18.560898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:18.567010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=48 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:18.569094 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:18.569584 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:18.570111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:18.570740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:18.571189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:18.571769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:18.738028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:18.739300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:18.748585 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:18.750002 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:18.750646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:18.751361 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:18.751814 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:18.752242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:18.753782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:18.762008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:18.763993 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:18.765562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d673d4e8-7260-47d4-8c27-325a2faf2790 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.210273 Oct 24 13:52:18.766422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 557/1120] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:18 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:18.787761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-eee6457a-5953-4f4d-9c35-ea088bbad4f6 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/ips" status: 200 len: 149 microversion: 2.1 time: 0.055214 Oct 24 13:52:18.788631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 564/1121] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 24 13:52:18 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:52:19.793961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:19.794679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:19.801473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:19.801958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:19.802429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:19.803158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:19.803606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:19.804024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:20.000823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:20.009479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:20.013179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:20.014649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3c2ebf58-ddbc-47b5-bb28-1c182a46cefe tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.224674 Oct 24 13:52:20.015813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 558/1122] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:19 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:20.308842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45d95739-f3d5-4ae8-842e-5d36b80f7302"}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:20.312697 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:20.316287 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:20.320596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:20.321125 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:20.321553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:20.322274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:20.322725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:20.323175 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:21.043878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:21.044821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:21.051524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:21.052197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:21.052832 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:21.053770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:21.054468 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:21.054904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:21.188435 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:21.197307 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:21.198769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:21.200462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-24426a9d-6523-4af6-92ff-6e1a5720804e tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.161042 Oct 24 13:52:21.203363 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 559/1123] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:21 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:52:22.228541 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:22.229159 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:22.236429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:22.236913 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:22.238005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:22.238105 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:22.238760 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:22.239224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:22.375266 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:22.383626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:22.385064 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:22.386311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0c7ad925-64a6-400c-b473-19d02032ef17 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.161763 Oct 24 13:52:22.386869 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 560/1124] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:22 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:52:23.413460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:23.414067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:23.421218 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:23.421695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:23.422124 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:23.422840 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:23.423286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:23.423698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:23.563060 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:23.571865 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:23.573294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:23.574474 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-719156b8-d58c-4311-b7a4-d436cae2fd5c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.164892 Oct 24 13:52:23.575130 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 561/1125] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:23 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:52:24.600631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:24.601255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:24.610070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:24.610574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:24.611006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:24.611698 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:24.612147 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:24.612570 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:24.742808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:24.751643 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:24.753081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:24.754263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-89998451-6cbd-4618-b7b9-07abf31e4a95 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.157578 Oct 24 13:52:24.754814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 562/1126] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:24 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:52:25.780800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:25.781482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:25.787801 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:25.788279 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:25.788711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:25.789431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:25.789883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:25.790341 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:25.924224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:25.926410 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:25.933916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:25.935654 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:25.936809 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-83bf35c2-b0cb-487f-a31b-cf548440ce31 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.160790 Oct 24 13:52:25.937360 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 563/1127] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:25 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:52:26.553995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:26.689060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fb5191f4-8afd-474b-bc4a-92e959b49001 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "POST /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.383920 Oct 24 13:52:26.689853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 565/1128] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 24 13:52:20 2022] POST /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments => generated 194 bytes in 6385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:52:26.962002 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:26.962564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:26.972310 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:26.972789 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:26.973224 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:26.973916 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:26.974398 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:26.974821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:27.105467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:27.114321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:27.115751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:27.116904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-221e4d22-919c-4b85-8b65-4fe44a585afb tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.158870 Oct 24 13:52:27.117433 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 564/1129] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:26 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:28.144246 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:28.144942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:28.151781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:28.152261 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:28.153190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:28.153872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:28.154356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:28.154779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:28.290236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:28.298856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:28.300297 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:28.301457 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6f118b4b-6f59-4344-99a4-1d3927813ff1 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.161986 Oct 24 13:52:28.302010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 566/1130] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:28 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:29.326864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:29.327485 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:29.333936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:29.334462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:29.334898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:29.335586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:29.336038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:29.336463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:29.463027 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:29.471458 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:29.472890 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:29.474026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0281ad44-5a9e-44d8-80fb-4373cd75cd46 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.151486 Oct 24 13:52:29.474602 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 565/1131] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:29 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:30.500655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:30.501198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:30.507537 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:30.508010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:30.508438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:30.509115 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:30.509564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:30.509981 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:30.639486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:30.647412 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:30.648847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:30.649994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cc127580-0b59-46bb-afe5-b0c641ff651f tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.154258 Oct 24 13:52:30.650586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 567/1132] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:30 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:31.675963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:31.676482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:31.682852 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:31.683324 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:31.683753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:31.684429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:31.685474 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:31.686039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:31.815806 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:31.823740 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:31.825167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:31.826373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-bd3c6189-7dbe-4867-a4fc-6afed5bad7b8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.154364 Oct 24 13:52:31.826918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 566/1133] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:31 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:32.852085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:32.852847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:32.859881 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:32.860363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:32.860796 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:32.861484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:32.861929 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:32.862389 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:33.000792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:33.009491 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:33.010904 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:33.012290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8c599b45-5df1-45b3-8d50-13b74452a9f3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.163999 Oct 24 13:52:33.013373 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 568/1134] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:32 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:33.106387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-f57eb74c-efd7-4997-b5d4-08a70c9a2fa6 req-42753669-90e6-4831-80c8-03a5e336beac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "name": "network-vif-plugged", "status": "completed", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:33.116339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f57eb74c-efd7-4997-b5d4-08a70c9a2fa6 req-42753669-90e6-4831-80c8-03a5e336beac service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:33.116808 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f57eb74c-efd7-4997-b5d4-08a70c9a2fa6 req-42753669-90e6-4831-80c8-03a5e336beac service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:33.117236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-f57eb74c-efd7-4997-b5d4-08a70c9a2fa6 req-42753669-90e6-4831-80c8-03a5e336beac service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:33.128488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-f57eb74c-efd7-4997-b5d4-08a70c9a2fa6 req-42753669-90e6-4831-80c8-03a5e336beac service nova] Creating event network-vif-plugged:21d722a6-32b9-4783-87d2-18e99bef65f0 for instance 41012da5-d2a4-4917-9415-3dfc4b40744c on hv-cinder-86249 Oct 24 13:52:33.133384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-f57eb74c-efd7-4997-b5d4-08a70c9a2fa6 req-42753669-90e6-4831-80c8-03a5e336beac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157285 Oct 24 13:52:33.133995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 567/1135] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:52:34.037890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:34.038534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:34.045404 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:34.045882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:34.046344 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:34.047042 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:34.047487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:34.048182 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:34.175494 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:34.183632 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:34.185571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:34.186755 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-49d09dfc-962e-4ac6-8aa8-2aac1c49b0d2 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.152761 Oct 24 13:52:34.187323 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 569/1136] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:34 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:35.214736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:35.215446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:35.223050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:35.223633 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:35.224004 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:35.224704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:35.225283 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:35.225713 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:35.431933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:35.442548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:35.444050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:35.445469 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7e8aa449-3869-4638-973e-24b2e1f6b23c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1732 microversion: 2.20 time: 0.235907 Oct 24 13:52:35.446538 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 568/1137] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:35 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1732 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:36.472554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:36.473172 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:36.479648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:36.480188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:36.480630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:36.481329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:36.482385 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:36.482813 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:36.617939 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:36.626425 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:36.627915 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:36.629068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f71bcc30-b66a-4e89-aedb-b2161e5fc013 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1719 microversion: 2.20 time: 0.160528 Oct 24 13:52:36.629772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 570/1138] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:52:36 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:52:38.715928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:38.716847 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:38.723792 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:38.724624 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:38.727077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:38.728163 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:38.728735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:38.729274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:38.828737 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lazy-loading 'services' on Instance uuid b3cfc03c-c908-414d-9102-509feacebab1 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:52:38.902894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-82352f07-4142-4dc5-a9e0-ee0349168642 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments/45d95739-f3d5-4ae8-842e-5d36b80f7302" status: 202 len: 0 microversion: 2.1 time: 0.191120 Oct 24 13:52:38.904117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 569/1139] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 24 13:52:38 2022] DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments/45d95739-f3d5-4ae8-842e-5d36b80f7302 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:52:38.914284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:38.916716 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:38.925279 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:38.925866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:38.926493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:38.927163 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:38.927681 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:38.928050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:38.959181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-85611172-8224-4f95-bdac-eb5d56aea524 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050543 Oct 24 13:52:38.959760 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 571/1140] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:52:38 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:52:39.972587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:39.974970 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:39.981479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:39.982138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:39.982592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:39.983305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:39.983753 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:39.984191 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:40.014814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fbec8f47-f826-432f-b576-ea1aaa98eb92 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046477 Oct 24 13:52:40.015453 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 570/1141] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 24 13:52:39 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:52:40.078269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:40.078789 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:40.084977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:40.085452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:40.085882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:40.086595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:40.087045 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:40.087464 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:40.112380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:52:40.191447 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-66588c0d-6224-4fcf-809d-822de0fdfb2d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 204 len: 0 microversion: 2.1 time: 0.117489 Oct 24 13:52:40.192026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 572/1142] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:40 2022] DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:52:40.201110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:40.201886 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:40.207811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:40.208284 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:40.208707 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:40.209442 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:40.209866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:40.210334 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:40.346731 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:40.355134 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4c57e53e-956b-4b37-83c3-2d3dcc57c300 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1679 microversion: 2.1 time: 0.158672 Oct 24 13:52:40.355678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 571/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:40 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:52:41.379832 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:41.380545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:41.387054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:41.387535 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:41.387970 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:41.389285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:41.389739 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:41.390174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:41.520548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:41.528175 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c8e791f2-e679-4748-ba1a-07375072cd9b tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1679 microversion: 2.1 time: 0.152732 Oct 24 13:52:41.528732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 573/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:41 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:52:42.552520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:42.553213 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:42.560019 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:42.560572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:42.561073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:42.562636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:42.563157 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:42.563651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:42.629486 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1461a94dd8ef48f79a0d8642a1bc1e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae58cf3c8178463296c8b633550a130e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:42.638230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8c8ca477-3a1e-419c-aa75-4b8c48cf2c10 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 200 len: 1612 microversion: 2.1 time: 0.089432 Oct 24 13:52:42.638816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 572/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:42 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:52:42.807221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-0932c97a-7540-42a1-bdf7-ae47a9f096d7 req-7fab29d4-9265-4ae1-8fde-51aa181cdb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cfc03c-c908-414d-9102-509feacebab1", "name": "network-vif-deleted", "tag": "21f67d0a-1a79-45cb-a359-195cfea065be"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:42.820351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0932c97a-7540-42a1-bdf7-ae47a9f096d7 req-7fab29d4-9265-4ae1-8fde-51aa181cdb5c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:42.821148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0932c97a-7540-42a1-bdf7-ae47a9f096d7 req-7fab29d4-9265-4ae1-8fde-51aa181cdb5c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:42.821649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0932c97a-7540-42a1-bdf7-ae47a9f096d7 req-7fab29d4-9265-4ae1-8fde-51aa181cdb5c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:42.834206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-0932c97a-7540-42a1-bdf7-ae47a9f096d7 req-7fab29d4-9265-4ae1-8fde-51aa181cdb5c service nova] Creating event network-vif-deleted:21f67d0a-1a79-45cb-a359-195cfea065be for instance b3cfc03c-c908-414d-9102-509feacebab1 on hv-cinder-86249 Oct 24 13:52:42.838907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-0932c97a-7540-42a1-bdf7-ae47a9f096d7 req-7fab29d4-9265-4ae1-8fde-51aa181cdb5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036020 Oct 24 13:52:42.839517 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 574/1146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:52:43.661313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:43.662119 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:43.668621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:43.669103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:43.669536 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:43.670264 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:43.670722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:43.671152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:43.685294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 HTTP/1.1 Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:43.687719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:43.689384 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'b3cfc03c-c908-414d-9102-509feacebab1'} Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:43.690277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:43.691593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:43.692748 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:43.692748 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-afa2d4db-1127-4595-96f4-19a059178907 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 404 len: 111 microversion: 2.1 time: 0.031878 Oct 24 13:52:43.692748 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 573/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:43 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:43.699120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6eaaa219-1749-4b25-928a-4bdc19fa370d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '.version_select at 0x7f8dc23d5160>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:43.720419 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6eaaa219-1749-4b25-928a-4bdc19fa370d tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919808944" status: 202 len: 0 microversion: 2.1 time: 0.025492 Oct 24 13:52:43.721142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 575/1148] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 24 13:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919808944 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:52:45.497236 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:45.497722 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:45.504597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:45.505067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:45.505490 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:45.506190 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:45.506631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:45.507043 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:45.521108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 HTTP/1.1 Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:45.522655 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.524295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'b3cfc03c-c908-414d-9102-509feacebab1'} Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:45.525386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.526876 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.528460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:45.528460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e3bacf0d-e6c9-43ac-9f68-a9a74adaeab3 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 404 len: 111 microversion: 2.1 time: 0.030569 Oct 24 13:52:45.528460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 574/1149] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:45 2022] DELETE /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:45.533687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:45.534446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: b3cfc03c-c908-414d-9102-509feacebab1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:45.540450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:45.540922 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:45.541348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:45.542025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:45.542513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:45.542925 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:45.556095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 HTTP/1.1 Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:45.558210 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.559677 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'b3cfc03c-c908-414d-9102-509feacebab1'} Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:45.560449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. Oct 24 13:52:45.561863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:45.563223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance b3cfc03c-c908-414d-9102-509feacebab1 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:45.563223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cf13dea7-ef3e-4996-aa51-91308c91e7ff tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1" status: 404 len: 111 microversion: 2.1 time: 0.030678 Oct 24 13:52:45.563223 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 576/1150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:45 2022] GET /compute/v2.1/servers/b3cfc03c-c908-414d-9102-509feacebab1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:46.713454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:46.713947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:46.720768 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.721237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.721663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.722383 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.722825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.723241 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.737303 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 HTTP/1.1 Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:46.738891 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.740503 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '5243fe8f-bbe8-4a2f-a52c-f013aba97508'} Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:46.741559 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.743123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.744741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:46.744741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-786d2f23-ed46-4145-90a8-6bfd3b8ed9dc tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 404 len: 111 microversion: 2.1 time: 0.030587 Oct 24 13:52:46.744741 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 575/1151] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:46 2022] DELETE /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:46.748603 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:46.749252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 5243fe8f-bbe8-4a2f-a52c-f013aba97508] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:46.755568 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.756041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.756468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.757150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.757595 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.758013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.771126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 HTTP/1.1 Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:46.772619 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.774211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '5243fe8f-bbe8-4a2f-a52c-f013aba97508'} Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:46.775247 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. Oct 24 13:52:46.776746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.778532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance 5243fe8f-bbe8-4a2f-a52c-f013aba97508 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:46.778532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ac290520-9618-4783-9e32-970f045c0fde tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508" status: 404 len: 111 microversion: 2.1 time: 0.029184 Oct 24 13:52:46.778532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 577/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:46 2022] GET /compute/v2.1/servers/5243fe8f-bbe8-4a2f-a52c-f013aba97508 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:46.783063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:46.783557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:46.789319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.789789 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.790255 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.790938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.791388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.791809 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.805516 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 HTTP/1.1 Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:46.807075 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.808688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '91c938be-b9de-4df6-a185-4a2aab5f3be8'} Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:46.809848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.811571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.813065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:46.813065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-80781713-1e61-4ddd-96be-90573cfab4f7 tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 404 len: 111 microversion: 2.1 time: 0.030100 Oct 24 13:52:46.813065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 576/1153] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:46 2022] DELETE /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:52:46.816835 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:46.817448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: 91c938be-b9de-4df6-a185-4a2aab5f3be8] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:46.823234 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.823700 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.824126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.824800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:46.825241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:46.825655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:46.838810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 HTTP/1.1 Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:46.840325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.841863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '91c938be-b9de-4df6-a185-4a2aab5f3be8'} Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:46.843456 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. Oct 24 13:52:46.845465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:46.847057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance 91c938be-b9de-4df6-a185-4a2aab5f3be8 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:46.847057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dfcd5655-1650-4a51-90f8-ae56e267989e tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8" status: 404 len: 111 microversion: 2.1 time: 0.028690 Oct 24 13:52:46.847057 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 578/1154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:46 2022] GET /compute/v2.1/servers/91c938be-b9de-4df6-a185-4a2aab5f3be8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:47.984329 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:47.984837 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:47.991117 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:47.991588 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:47.992015 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:47.992699 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:47.993143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:47.993557 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:48.007837 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a HTTP/1.1 Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:52:48.009388 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.011039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'dafd3f2b-d38e-4889-aa12-0c584189083a'} Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:48.017769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.019286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.020747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:48.020747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1810aa75-feb4-4218-9f64-3e5ffcb4cfef tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 404 len: 111 microversion: 2.1 time: 0.031334 Oct 24 13:52:48.020747 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 577/1155] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:52:47 2022] DELETE /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:52:48.020993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:48.020993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] [instance: dafd3f2b-d38e-4889-aa12-0c584189083a] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:48.025931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:48.026497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:48.026931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:48.027610 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:48.028058 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:48.028480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:48.042434 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] HTTP exception thrown: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Request method failure captured: Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a HTTP/1.1 Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpYjZ136j7WcP-f8ZIuefxr3QDF2jcgUjuguDUwY3ZTaqAVZ-E9aK95SyYgrfSVAAsmEeIecL-C50WhnqsWiXPZo4AIjpEg3m7tTXC_k8j19QGPCKLX6rf-_BpOT2DdPzYhkpGybO4_tcYy7c0KG88CJtYSfK9KsGSAnY6IGrRNZq58 Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:52:48.043931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ae58cf3c8178463296c8b633550a130e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ae58cf3c8178463296c8b633550a130e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: ae58cf3c8178463296c8b633550a130e Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-206573649 Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 1461a94dd8ef48f79a0d8642a1bc1e58 Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeNegativeTest-206573649-project Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.045544 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': 'dafd3f2b-d38e-4889-aa12-0c584189083a'} Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:52:48.046985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. Oct 24 13:52:48.048487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:52:48.049814 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] Returning 404 to user: Instance dafd3f2b-d38e-4889-aa12-0c584189083a could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:52:48.049814 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-00303f6f-44c3-40d8-bf3f-aad1870687cb tempest-AttachVolumeNegativeTest-206573649 tempest-AttachVolumeNegativeTest-206573649-project] 10.222.0.20 "GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a" status: 404 len: 111 microversion: 2.1 time: 0.029943 Oct 24 13:52:48.049814 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 579/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:48 2022] GET /compute/v2.1/servers/dafd3f2b-d38e-4889-aa12-0c584189083a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:52:57.250106 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-493395125", "imageRef": "b84f87f4-01e0-4f7e-aec5-cde886706bf6", "flavorRef": "452"}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:52:57.257594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=42 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:57.311783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] validate_networks() for None {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:52:57.587085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:52:57.587508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:52:57.587983 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:52:57.588389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:52:57.588798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:52:57.597713 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:57.598219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:57.598658 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:57.599390 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:57.599845 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:57.600269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:57.606875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:57.619424 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Getting quotas for project 9c61c491e2924ffe95acc3f4e189d37d. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:52:57.623385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Getting quotas for user 0d46e4243350431b9ff792b269b9e4be and project 9c61c491e2924ffe95acc3f4e189d37d. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:52:57.635280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:52:57.637653 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b84f87f4-01e0-4f7e-aec5-cde886706bf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:52:57.682173 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-91771a5c-c221-4fd7-a6d3-f56a3c21d45b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436781 Oct 24 13:52:57.683044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 578/1157] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:52:57.694870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-49f76461-5d1c-4233-8006-2b488b98c41e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:57.695642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-49f76461-5d1c-4233-8006-2b488b98c41e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:57.698403 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:57.754241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-49f76461-5d1c-4233-8006-2b488b98c41e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:57.761148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-49f76461-5d1c-4233-8006-2b488b98c41e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1214 microversion: 2.1 time: 0.070147 Oct 24 13:52:57.761705 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 580/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:57 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:52:58.785512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:58.786904 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:58.793914 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:58.794619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:58.795338 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:58.796359 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:58.797053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:58.797327 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:58.862520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:58.870893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3435e162-b357-44ad-8e1e-d11a2fac1b3c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1266 microversion: 2.1 time: 0.090798 Oct 24 13:52:58.871456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 579/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:58 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:52:59.895080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:52:59.895653 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:52:59.897452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:52:59.904641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:59.906009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:59.906560 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:59.907252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:52:59.907705 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:52:59.908128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:52:59.969587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:52:59.978133 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-495cd446-0a4e-4677-8cf6-4ebaded4640c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1272 microversion: 2.1 time: 0.086988 Oct 24 13:52:59.978724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 581/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:52:59 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:01.001936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:01.002592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:01.008910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:01.009390 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:01.009823 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:01.010546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:01.010995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:01.011420 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:01.072834 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:01.080382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-39467137-caf8-4b5f-bf91-922f22e000e5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1272 microversion: 2.1 time: 0.082938 Oct 24 13:53:01.080929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 580/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:00 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:02.103685 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:02.105032 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:02.112445 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:02.112928 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:02.113364 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:02.114060 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:02.114534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:02.114950 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:02.444874 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:02.452538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-34d1c340-9ff9-4037-9ed8-8da52624bc1e tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1272 microversion: 2.1 time: 0.352709 Oct 24 13:53:02.453381 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 582/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:02 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:03.475365 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:03.476000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:03.482495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:03.482986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:03.483419 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:03.484647 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:03.485205 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:03.485522 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:03.624897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:03.632617 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-97e57af8-4d87-4987-bc2a-b9e81f3bbab0 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.161177 Oct 24 13:53:03.633168 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 581/1163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:03 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:03.869007 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-e03261c2-487b-4ae0-a839-09e72df0c5eb req-7ed24c19-e020-4478-8e6a-e51ff42bfb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e49031-f328-426b-99a1-bda058c4421d", "tag": "6f4af902-127e-4c4d-9974-230400ef757f"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:53:03.880772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e03261c2-487b-4ae0-a839-09e72df0c5eb req-7ed24c19-e020-4478-8e6a-e51ff42bfb6d service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:03.881515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e03261c2-487b-4ae0-a839-09e72df0c5eb req-7ed24c19-e020-4478-8e6a-e51ff42bfb6d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:03.882100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e03261c2-487b-4ae0-a839-09e72df0c5eb req-7ed24c19-e020-4478-8e6a-e51ff42bfb6d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:03.895363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-e03261c2-487b-4ae0-a839-09e72df0c5eb req-7ed24c19-e020-4478-8e6a-e51ff42bfb6d service nova] Creating event network-changed:6f4af902-127e-4c4d-9974-230400ef757f for instance 64e49031-f328-426b-99a1-bda058c4421d on hv-cinder-86249 Oct 24 13:53:03.900098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-e03261c2-487b-4ae0-a839-09e72df0c5eb req-7ed24c19-e020-4478-8e6a-e51ff42bfb6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034739 Oct 24 13:53:03.900752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 583/1164] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:53:04.655895 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:04.656477 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:04.662996 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:04.663473 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:04.663903 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:04.664586 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:04.665029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:04.665445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:04.790445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:04.798080 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cca0b6ef-0f98-497b-b5d4-8f326a1e1084 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.146455 Oct 24 13:53:04.798668 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 582/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:04 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:05.821765 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:05.822476 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:05.829014 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:05.829487 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:05.829917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:05.830631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:05.831098 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:05.831488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:05.969309 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:05.979486 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-703b1956-d786-48cf-bf72-ea1aa226803b tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.162311 Oct 24 13:53:05.980065 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 584/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:05 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:07.003200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:07.003810 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:07.011252 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:07.011743 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:07.012179 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:07.012933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:07.013391 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:07.013818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:07.148579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:07.157314 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7d8efa3d-cf0e-48d8-903d-fc42dcd50d49 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.158109 Oct 24 13:53:07.157910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 583/1167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:06 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:08.181416 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:08.182134 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:08.188091 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:08.189893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:08.190349 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:08.190785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:08.191480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:08.191931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:08.192351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:08.333955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:08.341479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f613f503-2688-4925-8d8f-701a396ad7b5 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.164433 Oct 24 13:53:08.348645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 585/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:08 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:09.365937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:09.366524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:09.368407 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:09.369223 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:09.376339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:09.376811 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:09.377243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:09.377933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:09.378412 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:09.378836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:09.506085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:09.513749 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8010673e-e89a-4c29-be50-101ab0ccf231 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.151765 Oct 24 13:53:09.514335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 584/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:09 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:10.537100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:10.537717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:10.544068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:10.544553 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:10.544985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:10.545678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:10.546665 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:10.547109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:10.688360 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:10.696071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-dc0bb1c6-6c2d-4f3c-82a1-82d954b1ed68 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.162791 Oct 24 13:53:10.696635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 586/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:10 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:11.150399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-a0451f28-3677-4d1f-bcad-07746e9a371f req-78319325-34fa-4c1b-ac6d-b701ac51ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e49031-f328-426b-99a1-bda058c4421d", "name": "network-vif-plugged", "status": "completed", "tag": "6f4af902-127e-4c4d-9974-230400ef757f"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:53:11.163152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-a0451f28-3677-4d1f-bcad-07746e9a371f req-78319325-34fa-4c1b-ac6d-b701ac51ad5f service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:11.163638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-a0451f28-3677-4d1f-bcad-07746e9a371f req-78319325-34fa-4c1b-ac6d-b701ac51ad5f service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:11.164240 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-a0451f28-3677-4d1f-bcad-07746e9a371f req-78319325-34fa-4c1b-ac6d-b701ac51ad5f service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:11.175612 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-a0451f28-3677-4d1f-bcad-07746e9a371f req-78319325-34fa-4c1b-ac6d-b701ac51ad5f service nova] Creating event network-vif-plugged:6f4af902-127e-4c4d-9974-230400ef757f for instance 64e49031-f328-426b-99a1-bda058c4421d on hv-cinder-86249 Oct 24 13:53:11.180622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-a0451f28-3677-4d1f-bcad-07746e9a371f req-78319325-34fa-4c1b-ac6d-b701ac51ad5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034149 Oct 24 13:53:11.181489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 585/1171] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:53:11.719158 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:11.720169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:11.726637 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:11.727132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:11.727624 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:11.728318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:11.728788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:11.729180 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:11.870976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:11.879724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7d3a3508-c914-44a9-95a3-1f5481a118cd tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.164738 Oct 24 13:53:11.880289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 587/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:11 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:12.903248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:12.903958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:12.911825 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:12.912316 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:12.912782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:12.913656 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:12.914121 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:12.914574 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:13.090994 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:13.100254 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ac392923-015f-4e3b-a3d5-e40a149ee6cc tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1314 microversion: 2.1 time: 0.201150 Oct 24 13:53:13.101313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 586/1173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:12 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:14.126531 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:14.127143 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:14.133601 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:14.134079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:14.134572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:14.135263 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:14.135801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:14.136121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:14.284124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:14.291960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c9094cde-c310-4f44-99f3-e09de4fb287d tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1464 microversion: 2.1 time: 0.169947 Oct 24 13:53:14.292650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 588/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:14 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:14.343170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:14.344392 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:14.351053 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:14.351531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:14.351964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:14.352717 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:14.353177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:14.353613 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:14.380291 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:53:14.457532 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cbc03fa1-1b81-41a6-8809-97f17138124c tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 204 len: 0 microversion: 2.1 time: 0.117916 Oct 24 13:53:14.458115 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 587/1175] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:53:14 2022] DELETE /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:53:14.467325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:14.468473 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:14.474779 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:14.475257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:14.475721 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:14.476410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:14.476860 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:14.477457 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:14.615443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:14.623951 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-339571d3-8225-47ef-82c7-4e016239bdba tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1470 microversion: 2.1 time: 0.161383 Oct 24 13:53:14.624801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 589/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:14 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:15.648542 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:15.649263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:15.656416 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:15.657008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:15.657455 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:15.658181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:15.658635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:15.659058 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:15.812783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:15.825113 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-79d0b73a-46eb-4b7c-8c74-8473004999b7 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1470 microversion: 2.1 time: 0.180780 Oct 24 13:53:15.826211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 588/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:15 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:53:16.328320 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-8b626ac0-67b9-4a11-be46-7e9b1837975d req-aa4afc2e-84cf-4aaa-ae10-8fe087713100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e49031-f328-426b-99a1-bda058c4421d", "name": "network-vif-deleted", "tag": "6f4af902-127e-4c4d-9974-230400ef757f"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:53:16.341838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-8b626ac0-67b9-4a11-be46-7e9b1837975d req-aa4afc2e-84cf-4aaa-ae10-8fe087713100 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:16.342321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-8b626ac0-67b9-4a11-be46-7e9b1837975d req-aa4afc2e-84cf-4aaa-ae10-8fe087713100 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:16.342758 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-8b626ac0-67b9-4a11-be46-7e9b1837975d req-aa4afc2e-84cf-4aaa-ae10-8fe087713100 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:16.361599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-8b626ac0-67b9-4a11-be46-7e9b1837975d req-aa4afc2e-84cf-4aaa-ae10-8fe087713100 service nova] Creating event network-vif-deleted:6f4af902-127e-4c4d-9974-230400ef757f for instance 64e49031-f328-426b-99a1-bda058c4421d on hv-cinder-86249 Oct 24 13:53:16.370894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-8b626ac0-67b9-4a11-be46-7e9b1837975d req-aa4afc2e-84cf-4aaa-ae10-8fe087713100 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047818 Oct 24 13:53:16.371648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 590/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:53:16.854409 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:16.855867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:16.863857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:16.864745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:16.865520 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:16.866595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:16.867451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:16.868114 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:16.906585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:16.907169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:16.907764 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:16.908353 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lazy-loading 'fault' on Instance uuid 64e49031-f328-426b-99a1-bda058c4421d {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:53:16.951685 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d46e4243350431b9ff792b269b9e4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c61c491e2924ffe95acc3f4e189d37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:16.959635 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-441113be-6549-4458-b476-ba9eb3cce034 tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 200 len: 1304 microversion: 2.1 time: 0.109336 Oct 24 13:53:16.960200 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 589/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:16 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:17.985569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:17.986285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] [instance: 64e49031-f328-426b-99a1-bda058c4421d] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:17.992798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:17.993265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:17.993689 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:17.994398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:17.994842 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:17.995255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:18.007978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] HTTP exception thrown: Instance 64e49031-f328-426b-99a1-bda058c4421d could not be found. Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Request method failure captured: Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d HTTP/1.1 Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpi3lu2LKqZ2nESZTyi0Et1rTuW9dK3lBJ-g4Z4Fui-Bug4rMzQvbKVndQFKjCn2SglJJ4Nkz36fYDaHlTHlCm1OJ9Ex8BUGqxZzXwDhB_16vdpPouC1OQGl_NoJQVKnZiCwmncWXXcKs2_DBefbr23XCfNB9axsWCvjm_RsbgqlmA4 Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 9c61c491e2924ffe95acc3f4e189d37d Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-VolumesNegativeTest-230545620 Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:53:18.009550 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c61c491e2924ffe95acc3f4e189d37d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c61c491e2924ffe95acc3f4e189d37d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c61c491e2924ffe95acc3f4e189d37d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c61c491e2924ffe95acc3f4e189d37d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-VolumesNegativeTest-230545620 Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 9c61c491e2924ffe95acc3f4e189d37d Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-VolumesNegativeTest-230545620 Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-VolumesNegativeTest-230545620-project Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 0d46e4243350431b9ff792b269b9e4be Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-VolumesNegativeTest-230545620-project Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 64e49031-f328-426b-99a1-bda058c4421d could not be found. Oct 24 13:53:18.011047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '64e49031-f328-426b-99a1-bda058c4421d'} Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e49031-f328-426b-99a1-bda058c4421d could not be found. Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:53:18.011960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e49031-f328-426b-99a1-bda058c4421d could not be found. Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e49031-f328-426b-99a1-bda058c4421d could not be found. Oct 24 13:53:18.013641 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:18.016140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] Returning 404 to user: Instance 64e49031-f328-426b-99a1-bda058c4421d could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:53:18.016140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c0f44626-ee68-465b-a7e7-820b4f7a46cb tempest-VolumesNegativeTest-230545620 tempest-VolumesNegativeTest-230545620-project] 10.222.0.20 "GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d" status: 404 len: 111 microversion: 2.1 time: 0.030005 Oct 24 13:53:18.016140 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 591/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:53:17 2022] GET /compute/v2.1/servers/64e49031-f328-426b-99a1-bda058c4421d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:53:33.270887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:33.272042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:33.518466 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a0da4683-e295-4b30-abf0-678a02e54739 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Action: 'create', calling method: .version_select at 0x7f8dc28524c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-102228527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgRRBdvy2jK3o5CjXIoZSoIsp4KS8ZuRomGMawTN8+LKS9LdRGkWlxj8eozDdpF/3rA+zhX02w5u+FZLectJtL522ApG0b/76EleL+CLeWro8SP0xjrVovmmLO4GhSYig=="}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:53:33.549545 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-a0da4683-e295-4b30-abf0-678a02e54739 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Getting quotas for project fb8cb8c044ad40a09528d3e1248642a2. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:53:33.555417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-a0da4683-e295-4b30-abf0-678a02e54739 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Getting quotas for user d480fb668fa446debc095215f4d55928 and project fb8cb8c044ad40a09528d3e1248642a2. Resources: {'key_pairs'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:53:33.569319 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0da4683-e295-4b30-abf0-678a02e54739 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [f9d6bfdd-38e2-4f3b-9177-6b9c0af31c28] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 13:53:34.577919 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0da4683-e295-4b30-abf0-678a02e54739 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [f9d6bfdd-38e2-4f3b-9177-6b9c0af31c28] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47152. Oct 24 13:53:34.595022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a0da4683-e295-4b30-abf0-678a02e54739 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.329224 Oct 24 13:53:34.595636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 590/1181] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 24 13:53:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:53:34.912062 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:34.914345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:34.917130 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=25 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:34.917937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=54 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:53:34.925269 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:34.925764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:34.926225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:34.927160 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:34.927608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:34.928036 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:34.962394 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ebe58dfe-a523-45e7-a380-53feaa464773 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055369 Oct 24 13:53:34.963538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 592/1182] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 24 13:53:34 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:53:35.032385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:35.033101 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:35.039932 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:35.040386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:35.040886 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:35.041585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:35.042023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:35.042757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:35.070963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:53:35.169987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0b5b63ab-9a6c-489b-a627-dae4de5198d0 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 204 len: 0 microversion: 2.20 time: 0.142606 Oct 24 13:53:35.171650 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 591/1183] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 24 13:53:35 2022] DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:53:35.180305 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:35.182318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:35.189573 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:35.190367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:35.190786 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:35.192617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:35.193278 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:35.195369 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:35.389807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:35.399025 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:35.400475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:35.401650 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-da8f7000-01bd-4a41-bf02-734ab6f4ffa8 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.225819 Oct 24 13:53:35.404245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 593/1184] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:53:35 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:53:36.432175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:36.433553 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:36.441752 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:36.442269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:36.442826 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:36.443524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:36.444095 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:36.444691 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:36.586957 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:36.600689 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:36.603110 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:36.604971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-3b8ad489-9cd4-4e82-a337-452467a6b2de tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1725 microversion: 2.20 time: 0.177287 Oct 24 13:53:36.605805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 592/1185] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:53:36 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:53:37.641718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:37.642362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:37.658932 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:37.659944 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:37.660976 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:37.662043 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:37.662709 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:37.663760 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:37.673265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-8aa64fe8-edb6-46a1-9df6-646976505e6b req-d6bda8fe-f12b-401f-845d-7b98f73d3dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41012da5-d2a4-4917-9415-3dfc4b40744c", "name": "network-vif-deleted", "tag": "21d722a6-32b9-4783-87d2-18e99bef65f0"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:53:37.686947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-8aa64fe8-edb6-46a1-9df6-646976505e6b req-d6bda8fe-f12b-401f-845d-7b98f73d3dd1 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:37.688776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-8aa64fe8-edb6-46a1-9df6-646976505e6b req-d6bda8fe-f12b-401f-845d-7b98f73d3dd1 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:37.689218 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-8aa64fe8-edb6-46a1-9df6-646976505e6b req-d6bda8fe-f12b-401f-845d-7b98f73d3dd1 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:37.736467 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-8aa64fe8-edb6-46a1-9df6-646976505e6b req-d6bda8fe-f12b-401f-845d-7b98f73d3dd1 service nova] Creating event network-vif-deleted:21d722a6-32b9-4783-87d2-18e99bef65f0 for instance 41012da5-d2a4-4917-9415-3dfc4b40744c on hv-cinder-86249 Oct 24 13:53:37.758356 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-8aa64fe8-edb6-46a1-9df6-646976505e6b req-d6bda8fe-f12b-401f-845d-7b98f73d3dd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090955 Oct 24 13:53:37.759349 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 593/1186] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:53:37.801694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:37.829959 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:37.833289 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '16228db2ddd147969482871b600ac797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a578ee882e60456392c88a508d1a6db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:53:37.837593 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2144e953-670e-4c05-8f10-ad47aa08d833 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 200 len: 1657 microversion: 2.20 time: 0.199324 Oct 24 13:53:37.840733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 594/1187] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:53:37 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 1657 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:53:38.871278 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:38.871883 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:38.877995 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:38.878535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:38.878963 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:38.879642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:38.880086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:38.880504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:38.894689 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] HTTP exception thrown: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Request method failure captured: Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c HTTP/1.1 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpaTkgYqIo1A2ewO-Ik484rOhKjXAEiRO6HpW1_BRlHqRYtu2K3PA-kAZxqsk59KmkI6GFpH1_xxfUZiKSq0amOnamOEwDhJnJHMBwQzjDRIep3i4DpMIZueYg0WekFWoY_kLJaroKZYu6GU8isxL6pT0DA-pd8zLWUVk_6ePfikivQ Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:53:38.896355 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a578ee882e60456392c88a508d1a6db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 16228db2ddd147969482871b600ac797 Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:38.897868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '41012da5-d2a4-4917-9415-3dfc4b40744c'} Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:53:38.899050 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:38.900417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:38.901750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Returning 404 to user: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:53:38.901750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7da4bc9b-5c95-4aa6-87c1-a2d2fce7b964 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 404 len: 111 microversion: 2.20 time: 0.031266 Oct 24 13:53:38.901750 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 594/1188] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:53:38 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:53:38.907702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1bed9fb3-c168-44da-a2a1-9248642f916c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '.version_select at 0x7f8dc23c81f0>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:38.927443 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1bed9fb3-c168-44da-a2a1-9248642f916c tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882564882" status: 204 len: 0 microversion: 2.20 time: 0.024553 Oct 24 13:53:38.928020 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 595/1189] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 24 13:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882564882 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:53:40.755900 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:40.756394 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:40.762870 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:40.763402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:40.763845 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:40.764531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:40.765228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:40.765511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:40.779800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] HTTP exception thrown: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Request method failure captured: Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c HTTP/1.1 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpaTkgYqIo1A2ewO-Ik484rOhKjXAEiRO6HpW1_BRlHqRYtu2K3PA-kAZxqsk59KmkI6GFpH1_xxfUZiKSq0amOnamOEwDhJnJHMBwQzjDRIep3i4DpMIZueYg0WekFWoY_kLJaroKZYu6GU8isxL6pT0DA-pd8zLWUVk_6ePfikivQ Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:53:40.782057 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a578ee882e60456392c88a508d1a6db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 16228db2ddd147969482871b600ac797 Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.783771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '41012da5-d2a4-4917-9415-3dfc4b40744c'} Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:53:40.784688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.786211 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.787724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Returning 404 to user: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:53:40.787724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e6c1a119-1df7-4f12-b8dc-2780e7e74864 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 404 len: 111 microversion: 2.20 time: 0.031488 Oct 24 13:53:40.787724 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 595/1190] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 24 13:53:40 2022] DELETE /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:53:40.792530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:40.793139 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 41012da5-d2a4-4917-9415-3dfc4b40744c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:40.800271 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:40.800746 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:40.801176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:40.801865 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:40.802348 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:40.802768 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:40.815863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] HTTP exception thrown: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Request method failure captured: Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c HTTP/1.1 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpaTkgYqIo1A2ewO-Ik484rOhKjXAEiRO6HpW1_BRlHqRYtu2K3PA-kAZxqsk59KmkI6GFpH1_xxfUZiKSq0amOnamOEwDhJnJHMBwQzjDRIep3i4DpMIZueYg0WekFWoY_kLJaroKZYu6GU8isxL6pT0DA-pd8zLWUVk_6ePfikivQ Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:53:40.817427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a578ee882e60456392c88a508d1a6db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 16228db2ddd147969482871b600ac797 Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.819174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '41012da5-d2a4-4917-9415-3dfc4b40744c'} Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:53:40.820116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. Oct 24 13:53:40.821645 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:40.823631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Returning 404 to user: Instance 41012da5-d2a4-4917-9415-3dfc4b40744c could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:53:40.823631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a25dbe0b-7be3-49f9-9acb-298432f898bc tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c" status: 404 len: 111 microversion: 2.20 time: 0.030643 Oct 24 13:53:40.823631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 596/1191] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:53:40 2022] GET /compute/v2.1/servers/41012da5-d2a4-4917-9415-3dfc4b40744c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:53:41.967216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:41.968555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:41.975568 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:41.976081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:41.976853 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:41.977582 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:41.978042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:41.978673 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:41.995878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] HTTP exception thrown: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Request method failure captured: Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f HTTP/1.1 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpaTkgYqIo1A2ewO-Ik484rOhKjXAEiRO6HpW1_BRlHqRYtu2K3PA-kAZxqsk59KmkI6GFpH1_xxfUZiKSq0amOnamOEwDhJnJHMBwQzjDRIep3i4DpMIZueYg0WekFWoY_kLJaroKZYu6GU8isxL6pT0DA-pd8zLWUVk_6ePfikivQ Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:53:41.997444 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a578ee882e60456392c88a508d1a6db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 16228db2ddd147969482871b600ac797 Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:41.999273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '586f4ffe-7aa6-4602-a4bd-48b62c92198f'} Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:53:42.000246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.001571 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.002856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Returning 404 to user: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:53:42.002856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6ceb919c-3da0-485f-84c6-92ae0c12c0b3 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 404 len: 111 microversion: 2.20 time: 0.035540 Oct 24 13:53:42.002856 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 596/1192] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 24 13:53:41 2022] DELETE /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:53:42.007438 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:53:42.008044 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] [instance: 586f4ffe-7aa6-4602-a4bd-48b62c92198f] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:53:42.014402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:42.015367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:42.015792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:42.016469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:53:42.016913 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:53:42.017326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:53:42.031069 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] HTTP exception thrown: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Request method failure captured: Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f HTTP/1.1 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpaTkgYqIo1A2ewO-Ik484rOhKjXAEiRO6HpW1_BRlHqRYtu2K3PA-kAZxqsk59KmkI6GFpH1_xxfUZiKSq0amOnamOEwDhJnJHMBwQzjDRIep3i4DpMIZueYg0WekFWoY_kLJaroKZYu6GU8isxL6pT0DA-pd8zLWUVk_6ePfikivQ Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:53:42.032540 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a578ee882e60456392c88a508d1a6db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a578ee882e60456392c88a508d1a6db3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: a578ee882e60456392c88a508d1a6db3 Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-753746567 Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 16228db2ddd147969482871b600ac797 Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-753746567-project Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.034342 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '586f4ffe-7aa6-4602-a4bd-48b62c92198f'} Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:53:42.035192 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. Oct 24 13:53:42.036538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:53:42.037792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] Returning 404 to user: Instance 586f4ffe-7aa6-4602-a4bd-48b62c92198f could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:53:42.037792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ab54d257-942f-4eb7-9954-09edab172c20 tempest-AttachVolumeShelveTestJSON-753746567 tempest-AttachVolumeShelveTestJSON-753746567-project] 10.222.0.20 "GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f" status: 404 len: 111 microversion: 2.20 time: 0.030455 Oct 24 13:53:42.037792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 597/1193] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 24 13:53:42 2022] GET /compute/v2.1/servers/586f4ffe-7aa6-4602-a4bd-48b62c92198f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:54:04.252371 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:04.253071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:04.255312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=4 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:04.256625 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:04.257462 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:04.264986 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:04.265332 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:04.265766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:04.266514 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:04.266968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:04.267406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:04.294604 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:54:04.374280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-486ced9a-bcea-4798-aab9-8cf605200a39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 204 len: 0 microversion: 2.1 time: 0.126066 Oct 24 13:54:04.375046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 597/1194] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:54:04 2022] DELETE /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:54:04.383750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:04.384372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:04.387125 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:04.387926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=22 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:04.394640 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:04.395123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:04.395564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:04.396264 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:04.396799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:04.397216 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:04.529499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:04.538100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b78772cb-ec9b-4389-b8f7-1f2614b245cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1577 microversion: 2.1 time: 0.158400 Oct 24 13:54:04.538767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 598/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:04 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:05.563134 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:05.563835 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:05.570814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:05.571294 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:05.571728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:05.572414 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:05.572867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:05.573290 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:05.705014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:05.712848 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b1bd35fe-9f28-490f-bfbc-728989c4acc4 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1577 microversion: 2.1 time: 0.154005 Oct 24 13:54:05.713413 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 598/1196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:05 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:05.902794 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-345776668", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-102228527", "security_groups": [{"name": "tempest-secgroup-smoke-1299130414"}], "networks": [{"uuid": "0da626dd-daae-4af9-bcf2-5f83419e74bb"}], "block_device_mapping_v2": [{"uuid": "292a032a-4442-4798-a1d0-be456f6936aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:06.018106 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] validate_networks() for [('0da626dd-daae-4af9-bcf2-5f83419e74bb', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:54:06.493795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:54:06.494329 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:54:06.494942 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:54:06.495506 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:54:06.496074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:54:06.505398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:06.506074 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:06.506555 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:06.507490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:06.508047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:06.508545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:06.526548 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Getting quotas for project fb8cb8c044ad40a09528d3e1248642a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:54:06.530820 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Getting quotas for user d480fb668fa446debc095215f4d55928 and project fb8cb8c044ad40a09528d3e1248642a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:54:06.598459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:54:06.600583 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='292a032a-4442-4798-a1d0-be456f6936aa',volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:54:06.735979 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:06.737148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:06.745192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:06.745958 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:06.746739 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:06.747454 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:06.747918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:06.748347 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:06.756343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ff7c0694-f7c2-4fd7-8b1c-07cb314c9ca5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857195 Oct 24 13:54:06.757211 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 599/1197] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:54:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:54:06.768337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fbe7fe7f-e3d1-4fde-b223-727e9e84f809 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:06.769315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fbe7fe7f-e3d1-4fde-b223-727e9e84f809 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:06.849608 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fbe7fe7f-e3d1-4fde-b223-727e9e84f809 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:06.859406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fbe7fe7f-e3d1-4fde-b223-727e9e84f809 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1087 microversion: 2.1 time: 0.095092 Oct 24 13:54:06.867135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 600/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:06 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1087 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:06.894793 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:06.904297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-20853187-654b-4c79-a73f-eb98f6f04a43 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1577 microversion: 2.1 time: 0.172110 Oct 24 13:54:06.906196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 599/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:06 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:07.588850 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-e1f7f761-5ec9-4a73-9e54-3494ba5f31af req-706bb6ab-b6e6-419f-8041-fa2c5a1536e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cda293-d706-482f-acba-625c087884e9", "name": "network-vif-deleted", "tag": "1ed5217e-752e-4e33-a295-fe9ba63194d4"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:07.598737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e1f7f761-5ec9-4a73-9e54-3494ba5f31af req-706bb6ab-b6e6-419f-8041-fa2c5a1536e1 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:07.599221 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e1f7f761-5ec9-4a73-9e54-3494ba5f31af req-706bb6ab-b6e6-419f-8041-fa2c5a1536e1 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:07.599752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-e1f7f761-5ec9-4a73-9e54-3494ba5f31af req-706bb6ab-b6e6-419f-8041-fa2c5a1536e1 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:07.613512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-e1f7f761-5ec9-4a73-9e54-3494ba5f31af req-706bb6ab-b6e6-419f-8041-fa2c5a1536e1 service nova] Creating event network-vif-deleted:1ed5217e-752e-4e33-a295-fe9ba63194d4 for instance 96cda293-d706-482f-acba-625c087884e9 on hv-cinder-86249 Oct 24 13:54:07.618722 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-e1f7f761-5ec9-4a73-9e54-3494ba5f31af req-706bb6ab-b6e6-419f-8041-fa2c5a1536e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159258 Oct 24 13:54:07.619321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 601/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:54:07.883439 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:07.884085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:07.890835 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:07.891329 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:07.891773 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:07.893177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:07.893631 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:07.894059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:07.930493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:07.931243 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:07.937636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:07.938117 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:07.938629 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:07.940303 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:07.941170 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:07.941843 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:07.964560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:07.972901 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-09230547-24e4-4387-aa41-42cde6b041cb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1137 microversion: 2.1 time: 0.093410 Oct 24 13:54:07.984297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 600/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:07 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1137 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:08.009080 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:08.016964 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-d248579b-8a96-4724-9310-e4482b32588a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1509 microversion: 2.1 time: 0.091722 Oct 24 13:54:08.030188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 602/1202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:07 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1509 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:08.996615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:08.997274 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:09.003706 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:09.004187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:09.004619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:09.005297 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:09.005748 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:09.006182 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:09.040643 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:09.041312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:09.047805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:09.048298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:09.048887 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:09.049517 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:09.049971 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:09.050513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:09.067587 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:09.075558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-58c29ca2-0961-41d5-a35c-30a897ed7f90 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1137 microversion: 2.1 time: 0.082857 Oct 24 13:54:09.076309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 601/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:08 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:09.114951 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:09.122674 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-25d3ad40-2ed9-4c6a-8856-401fd73d8f09 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1225 microversion: 2.1 time: 0.085885 Oct 24 13:54:09.123233 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 603/1204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:09 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:10.099501 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:10.100144 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:10.106492 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:10.106969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:10.107422 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:10.108111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:10.108592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:10.109012 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:10.144718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:10.145330 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:10.151791 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:10.152274 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:10.152718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:10.153422 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:10.153870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:10.154315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:10.172056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:10.180272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c3898b1f-bac3-4c87-bd79-9c09ebfe6806 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1137 microversion: 2.1 time: 0.085100 Oct 24 13:54:10.181029 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 602/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:10 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:10.217513 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:10.225916 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b2ab206c-d8cf-4523-9701-1e42b22c964f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1225 microversion: 2.1 time: 0.085001 Oct 24 13:54:10.226496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 604/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:10 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:11.206778 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:11.207488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:11.215456 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:11.216174 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:11.216615 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:11.217309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:11.217755 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:11.218192 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:11.248921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:11.249657 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:11.257983 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:11.258496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:11.258926 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:11.259655 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:11.260238 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:11.260668 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:11.282610 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:11.291937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-acf2fab5-8cb1-4b67-9a1f-c8628188fa4f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1185 microversion: 2.1 time: 0.089493 Oct 24 13:54:11.297547 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 603/1207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:11 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:11.325602 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:11.333871 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6e200992-211c-41e2-bac9-252653f088ca tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1225 microversion: 2.1 time: 0.088838 Oct 24 13:54:11.334465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 605/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:11 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:12.319172 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:12.319791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:12.327783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:12.329250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:12.329695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:12.331562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:12.332068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:12.349278 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:12.358023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:12.358798 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:12.368691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:12.369819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:12.370367 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:12.371105 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:12.371570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:12.372004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:12.415178 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:12.415732 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:12.416267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:12.416726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.objects.instance [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lazy-loading 'fault' on Instance uuid 96cda293-d706-482f-acba-625c087884e9 {{(pid=125456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:54:12.474362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:12.485307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3a7530c6-92e1-4dc0-a9da-98e342ea548c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 200 len: 1230 microversion: 2.1 time: 0.131355 Oct 24 13:54:12.485890 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 606/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:12 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 1230 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:12.599356 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:12.607141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0c3efbeb-f265-44b6-9070-e0104cf4bf7b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1271 microversion: 2.1 time: 0.293450 Oct 24 13:54:12.607695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 604/1210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:12 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:13.100266 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-551f600f-a996-4aaf-9a57-adb5e261a134 req-54f739e9-2013-4efd-b08c-b4682cde6a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:13.110304 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-551f600f-a996-4aaf-9a57-adb5e261a134 req-54f739e9-2013-4efd-b08c-b4682cde6a9a service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:13.111076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-551f600f-a996-4aaf-9a57-adb5e261a134 req-54f739e9-2013-4efd-b08c-b4682cde6a9a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:13.112215 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-551f600f-a996-4aaf-9a57-adb5e261a134 req-54f739e9-2013-4efd-b08c-b4682cde6a9a service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:13.125664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-551f600f-a996-4aaf-9a57-adb5e261a134 req-54f739e9-2013-4efd-b08c-b4682cde6a9a service nova] Creating event network-changed:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:54:13.131003 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-551f600f-a996-4aaf-9a57-adb5e261a134 req-54f739e9-2013-4efd-b08c-b4682cde6a9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036082 Oct 24 13:54:13.131788 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 607/1211] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:54:13.514448 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:13.515968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:13.523186 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:13.523674 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:13.524116 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:13.524818 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:13.525271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:13.525695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:13.540382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] HTTP exception thrown: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Request method failure captured: Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 HTTP/1.1 Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpg5jLNWLF5zCjjI4FlCkKPXiNGun0bLWVlW1l03eq0VEV0srLt-gBBu2UYuJYVacFm9PAgAJ6xeqBJmnhQ9KBJcC190BRWk3_K7e0M6KBedkMJyL3rr93a4LtB0D5kPDEroFwxkt9w9KBuBwReIL2vagYWAw0zxAcmR8vHfuOQUpKw Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:54:13.542041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5db8c3fdabf94498948055239da40ca0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-TestVolumeBootPattern-844646618 Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 568d031158744101a6bb339e51149ed2 Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:54:13.543831 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '96cda293-d706-482f-acba-625c087884e9'} Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:54:13.545000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:54:13.546784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:54:13.548594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Returning 404 to user: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:54:13.548594 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-88c9e54f-0fa4-44ec-8def-9964ebd77e65 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 404 len: 111 microversion: 2.1 time: 0.033094 Oct 24 13:54:13.550521 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 605/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:13 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:54:13.632461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:13.633171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:13.639415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-400372099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-519842543", "security_groups": [{"name": "tempest-secgroup-smoke-2089865704"}], "block_device_mapping_v2": [{"uuid": "207db82b-099d-4cc0-996e-cb93e61e2a7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0a27a795-3bd6-4937-8a2d-83219efd0aaa"}]}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:13.639633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:13.639955 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:13.640372 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:13.641066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:13.641549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:13.641977 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:13.755197 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.network.neutron [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] validate_networks() for [('0a27a795-3bd6-4937-8a2d-83219efd0aaa', None, None, None, None, None)] {{(pid=125457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:54:13.775488 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:13.784162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c9628906-cc8e-45bb-9e9c-24cb4cabe1fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.156521 Oct 24 13:54:13.784750 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 608/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:13 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:14.131517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Flavor limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:54:14.131943 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Image limits 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:54:14.132445 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Flavor pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:54:14.132851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Image pref 0:0:0 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:54:14.133277 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.virt.hardware [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:54:14.142709 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:14.143220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:14.143764 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:14.144488 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:14.144945 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:14.145367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:14.162626 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for project 5db8c3fdabf94498948055239da40ca0. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:54:14.166556 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.quota [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for user 568d031158744101a6bb339e51149ed2 and project 5db8c3fdabf94498948055239da40ca0. Resources: {'ram', 'instances', 'cores'} {{(pid=125457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:54:14.224171 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Going to run 1 instances... {{(pid=125457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:54:14.226374 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='207db82b-099d-4cc0-996e-cb93e61e2a7b',volume_size=None,volume_type=None)] {{(pid=125457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:54:14.360775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-25ace3ec-0450-488d-b96b-f5e8159e5245 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725240 Oct 24 13:54:14.361849 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 606/1214] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:54:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:54:14.372863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-37dae39f-0fc0-4050-8c9c-884d1ad35591 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:14.373480 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-37dae39f-0fc0-4050-8c9c-884d1ad35591 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:14.430008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-37dae39f-0fc0-4050-8c9c-884d1ad35591 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:14.437006 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-37dae39f-0fc0-4050-8c9c-884d1ad35591 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1093 microversion: 2.1 time: 0.068026 Oct 24 13:54:14.437564 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 609/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:14 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:14.808247 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:14.808851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:14.816681 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:14.817160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:14.817618 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:14.818337 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:14.818784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:14.819201 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:14.950251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:14.957980 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2019bda4-0f9c-4c69-958d-929f2424d2af tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.154167 Oct 24 13:54:14.958562 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 607/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:14 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:15.460587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:15.461251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:15.467167 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:15.467644 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:15.468077 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:15.468758 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:15.469212 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:15.469631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:15.537927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:15.545589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e1ecaf0d-5484-438a-9d5a-1851b0a60400 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1143 microversion: 2.1 time: 0.089029 Oct 24 13:54:15.546145 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 610/1217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:15 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:15.980533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:15.981140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:15.987846 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:15.988325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:15.988759 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:15.989451 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:15.989906 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:15.990366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:16.123554 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:16.131814 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1565fb2c-8868-4eb7-a84b-d7e6882bef86 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.155191 Oct 24 13:54:16.132374 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 608/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:15 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:16.568767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:16.569315 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:16.572219 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:16.578366 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:16.578849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:16.579502 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:16.580525 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:16.580979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:16.581733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:16.653915 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:16.662894 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2e1eeb91-b596-4061-8c98-8d4fbcc6bec0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1143 microversion: 2.1 time: 0.098130 Oct 24 13:54:16.663494 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 611/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:16 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:17.155738 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:17.156348 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:17.163711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:17.164301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:17.164736 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:17.165421 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:17.165866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:17.166309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:17.296071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:17.303782 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d2c65f4a-1c9f-496b-86b2-1a9e473dcf8d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.152138 Oct 24 13:54:17.304350 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 609/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:17 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:17.688307 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:17.689109 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:17.696671 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:17.697162 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:17.697599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:17.698351 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:17.698815 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:17.699241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:17.762684 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:17.771056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3302d96e-f025-4082-9003-422cfbe87566 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1143 microversion: 2.1 time: 0.086767 Oct 24 13:54:17.771627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 612/1221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:17 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:18.327286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:18.328563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:18.336006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:18.336487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:18.336917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:18.337622 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:18.338068 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:18.338546 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:18.489675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:18.497866 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-7e8a4f24-cfd3-4c9c-834c-ffc5f000fe81 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.174498 Oct 24 13:54:18.498756 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 610/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:18 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:18.795726 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:18.797099 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:18.807317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:18.808343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:18.809120 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:18.809902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:18.810666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:18.811539 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:18.915921 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:18.926459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-b9a09d1d-19f4-4109-bce7-4813bbd10d5e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1199 microversion: 2.1 time: 0.136600 Oct 24 13:54:18.927169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 613/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:18 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1199 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:19.521399 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:19.521927 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:19.528039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:19.528518 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:19.528948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:19.529638 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:19.530085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:19.530787 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:19.663929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:19.671487 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-44a6d617-f0d8-49e4-babd-0dd59a7ea56d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.154536 Oct 24 13:54:19.672071 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 611/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:19 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:19.952064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:19.952822 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:19.959321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:19.959809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:19.960356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:19.961072 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:19.961695 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:19.962402 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:20.218979 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:20.228430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fd01046d-09b3-484e-a8c5-959f5929e819 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.281395 Oct 24 13:54:20.229678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 614/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:19 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:20.557073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-11b3ced1-9dc3-42d0-9855-c4efcbd09766 req-8577e9c2-cdb0-464c-bbca-abaf10ffdcbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afb1125-ca3f-42ed-9221-a0b71a20a2de", "tag": "94e0438a-f4e0-4b1c-917c-2902573e08d8"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:20.567138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-11b3ced1-9dc3-42d0-9855-c4efcbd09766 req-8577e9c2-cdb0-464c-bbca-abaf10ffdcbf service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:20.567611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-11b3ced1-9dc3-42d0-9855-c4efcbd09766 req-8577e9c2-cdb0-464c-bbca-abaf10ffdcbf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:20.568042 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-11b3ced1-9dc3-42d0-9855-c4efcbd09766 req-8577e9c2-cdb0-464c-bbca-abaf10ffdcbf service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:20.579560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-11b3ced1-9dc3-42d0-9855-c4efcbd09766 req-8577e9c2-cdb0-464c-bbca-abaf10ffdcbf service nova] Creating event network-changed:94e0438a-f4e0-4b1c-917c-2902573e08d8 for instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de on hv-cinder-86249 Oct 24 13:54:20.584311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-11b3ced1-9dc3-42d0-9855-c4efcbd09766 req-8577e9c2-cdb0-464c-bbca-abaf10ffdcbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030928 Oct 24 13:54:20.584874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 612/1226] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:54:20.693818 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:20.694517 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:20.700502 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:20.700985 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:20.701450 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:20.702139 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:20.702615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:20.703038 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:20.832312 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:20.839826 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0101034e-9da3-46a1-984b-46d40d76d2e4 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.149859 Oct 24 13:54:20.840378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 615/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:20 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:21.254152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:21.254873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:21.261088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:21.261564 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:21.262133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:21.262697 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:21.263143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:21.263561 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:21.399239 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:21.402678 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:21.407789 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-20ec94cc-5fef-474e-b9bf-d9313c3b0a29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.158684 Oct 24 13:54:21.408478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 613/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:21 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:21.863176 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:21.863790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:21.870300 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:21.870777 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:21.871207 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:21.871895 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:21.872343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:21.872764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:22.007778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:22.015474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e6e226d0-5182-4e8f-9860-75ed854a6539 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.156783 Oct 24 13:54:22.016050 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 616/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:21 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:22.430920 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:22.431527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:22.438619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:22.439118 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:22.439833 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:22.440524 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:22.440970 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:22.441387 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:22.572001 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:22.580333 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1881c6d4-93df-43e2-afce-b9f98df1239e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.153131 Oct 24 13:54:22.580926 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 614/1230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:22 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:23.038068 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:23.038760 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:23.045184 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:23.045664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:23.046099 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:23.046825 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:23.047281 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:23.047705 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:23.178762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:23.186301 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7c2e0e82-9bcd-4ff5-8ed7-f2de0f6fd3e5 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.152125 Oct 24 13:54:23.186853 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 617/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:23 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:23.602480 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:23.603026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:23.609344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:23.609816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:23.610267 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:23.611766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:23.612535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:23.613030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:23.739175 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:23.746816 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-352008cc-8a48-4cb5-ab29-bb6fed86d581 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.148401 Oct 24 13:54:23.747377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 615/1232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:23 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:24.209495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:24.210110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:24.216563 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:24.217039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:24.217520 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:24.218268 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:24.218725 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:24.219148 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:24.223291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=100 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:24.352512 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:24.360265 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2a9296ec-ed57-4fdd-a160-5bcbce3c8cce tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.154627 Oct 24 13:54:24.373666 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 618/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:24 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:24.770112 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:24.770807 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:24.772664 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:24.773313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=6 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:24.778992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:24.779463 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:24.779887 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:24.780815 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:24.781261 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:24.781680 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:24.916243 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:24.924427 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-78995545-9d32-44f4-81ae-243ec964bda2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.158429 Oct 24 13:54:24.924990 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 616/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:24 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:25.384187 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:25.384609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:25.386345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=10 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:25.393121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:25.393599 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:25.394034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:25.394761 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:25.395214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:25.395635 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:25.536882 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:25.546340 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-eada449d-3b66-4f9e-9458-ee7f7f511525 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.165844 Oct 24 13:54:25.546466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 619/1235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:25 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:25.947322 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:25.947937 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:25.954336 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:25.954938 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:25.955377 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:25.956059 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:25.956526 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:25.956929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:26.084256 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:26.091881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c167dc9e-1569-4867-af6c-ced5da712ab3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.148500 Oct 24 13:54:26.092436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 617/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:25 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:26.568496 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:26.569113 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:26.575534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:26.576012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:26.576446 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:26.577135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:26.577586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:26.578008 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:26.744685 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:26.760769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3d24e47a-daa8-4007-a35f-456591c9bbcb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.196027 Oct 24 13:54:26.761515 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 620/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:26 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:27.116352 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:27.117169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:27.124046 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:27.124675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:27.125244 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:27.126055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:27.127278 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:27.127917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:27.273167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:27.282707 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ef62609c-613e-40df-8a9d-ddab370cff80 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.171582 Oct 24 13:54:27.283136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 618/1238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:27 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:27.784857 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:27.785466 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:27.791869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:27.792286 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:27.792717 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:27.793399 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:27.793851 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:27.794295 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:27.924026 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:27.931554 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3a79384f-62e7-4306-89fc-8933285e1088 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.151565 Oct 24 13:54:27.932116 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 621/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:27 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:28.304969 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:28.305661 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:28.311961 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:28.312437 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:28.312867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:28.313665 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:28.314123 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:28.314585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:28.445136 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:28.452746 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-6b623df9-aebd-4bb8-8cd9-730c84f95b38 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.151696 Oct 24 13:54:28.453308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 619/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:28 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:28.954193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:28.955406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:28.961743 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:28.962248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:28.962682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:28.963362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:28.963879 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:28.964291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:29.101030 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:29.108859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1b3e8100-af0d-4d3e-bf44-02ecabf2e294 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.158486 Oct 24 13:54:29.109421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 622/1241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:28 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:29.175299 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-974c22d3-bf57-4e2e-a8cd-70dc87c17060 req-59029b2e-2fa4-43fc-8d5e-aaf9594ded0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "name": "network-vif-plugged", "status": "completed", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:29.184596 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-974c22d3-bf57-4e2e-a8cd-70dc87c17060 req-59029b2e-2fa4-43fc-8d5e-aaf9594ded0b service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:29.185074 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-974c22d3-bf57-4e2e-a8cd-70dc87c17060 req-59029b2e-2fa4-43fc-8d5e-aaf9594ded0b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:29.185513 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-974c22d3-bf57-4e2e-a8cd-70dc87c17060 req-59029b2e-2fa4-43fc-8d5e-aaf9594ded0b service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:29.201084 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-974c22d3-bf57-4e2e-a8cd-70dc87c17060 req-59029b2e-2fa4-43fc-8d5e-aaf9594ded0b service nova] Creating event network-vif-plugged:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:54:29.207033 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-974c22d3-bf57-4e2e-a8cd-70dc87c17060 req-59029b2e-2fa4-43fc-8d5e-aaf9594ded0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036017 Oct 24 13:54:29.208158 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 620/1242] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:54:29.477935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:29.478485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:29.484290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:29.484762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:29.485190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:29.486656 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:29.487393 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:29.487817 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:29.629284 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:29.637497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-1a1a9712-0ef5-46c2-9bf6-d2ef559cda94 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.163935 Oct 24 13:54:29.638067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 623/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:29 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:30.133434 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:30.134765 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:30.141472 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:30.142894 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:30.143719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:30.144712 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:30.145260 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:30.145746 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:30.287280 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:30.297219 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-2e08e03e-c599-45f0-8143-b461e49ef0e1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1259 microversion: 2.1 time: 0.167649 Oct 24 13:54:30.297860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 621/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:30 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:30.661906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:30.662652 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:30.668920 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:30.669397 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:30.669829 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:30.670547 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:30.671001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:30.671414 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:30.808149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:30.816872 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f8583312-3503-4d45-a57c-7d57396dbca7 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.159261 Oct 24 13:54:30.830188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 624/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:30 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:31.321069 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:31.321784 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:31.328206 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:31.328682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:31.329111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:31.330325 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:31.330822 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:31.331320 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:31.469875 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:31.478537 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d80e4a3b-07a4-44ab-baa2-f848d795d6ec tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1443 microversion: 2.1 time: 0.161283 Oct 24 13:54:31.479133 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 622/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:31 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:31.501097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:31.501770 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:31.508010 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:31.508723 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:31.509156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:31.509848 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:31.510321 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:31.510804 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:31.647458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:31.655949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c9e0d0c6-f76a-4fc4-a971-be54d3278d85 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1443 microversion: 2.1 time: 0.158261 Oct 24 13:54:31.656417 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 625/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:31 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:31.840535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:31.841237 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:31.848006 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:31.848577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:31.849082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:31.849971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:31.850527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:31.850953 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:32.064649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:32.074382 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-b02bc67c-c0c2-4ad8-8ab6-f0340e3364c3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.237651 Oct 24 13:54:32.075119 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 623/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:31 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:33.098949 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:33.100336 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:33.106799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:33.107283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:33.107718 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:33.108406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:33.108856 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:33.109276 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:33.252897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:33.261273 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-411ce8f0-7bf1-4559-ae08-9d2acfbf3053 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.166303 Oct 24 13:54:33.261995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 626/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:33 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:33.913189 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-e5930a1d-c42d-435d-920d-78931a0064ac req-10335456-0bf7-41b8-9654-43975566c604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:33.923766 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-e5930a1d-c42d-435d-920d-78931a0064ac req-10335456-0bf7-41b8-9654-43975566c604 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:33.924457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-e5930a1d-c42d-435d-920d-78931a0064ac req-10335456-0bf7-41b8-9654-43975566c604 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:33.924889 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-e5930a1d-c42d-435d-920d-78931a0064ac req-10335456-0bf7-41b8-9654-43975566c604 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:33.939233 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-e5930a1d-c42d-435d-920d-78931a0064ac req-10335456-0bf7-41b8-9654-43975566c604 service nova] Creating event network-changed:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:54:33.945286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-e5930a1d-c42d-435d-920d-78931a0064ac req-10335456-0bf7-41b8-9654-43975566c604 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205049 Oct 24 13:54:33.946041 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 624/1250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:54:34.285952 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:34.286625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:34.293124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:34.293603 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:34.294034 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:34.294762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:34.295214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:34.295633 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:34.513012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:34.521741 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-54a94b32-c1e1-4b01-80dd-a99f87114c7e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.240315 Oct 24 13:54:34.522343 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 627/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:34 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:35.546505 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:35.547216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:35.550032 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:35.555775 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:35.556346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:35.556867 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:35.557675 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:35.558269 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:35.558799 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:35.710679 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:35.718942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ea9430af-a89d-4913-8f8f-d71edd92670f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.177264 Oct 24 13:54:35.719666 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 625/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:35 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:36.744076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:36.744691 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:36.747191 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:54:36.753051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:36.753534 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:36.753967 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:36.754692 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:36.755146 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:36.755565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:36.895339 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:36.902914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-65da7c16-5aa2-4cf0-8363-6e01bd8e462f tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.162601 Oct 24 13:54:36.903462 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 628/1253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:36 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:37.206305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-126c9b6c-e458-4622-b98c-3ca67a11c122 req-4343f696-a82d-4183-860a-7d7e96a21bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afb1125-ca3f-42ed-9221-a0b71a20a2de", "name": "network-vif-plugged", "status": "completed", "tag": "94e0438a-f4e0-4b1c-917c-2902573e08d8"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:37.218857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-126c9b6c-e458-4622-b98c-3ca67a11c122 req-4343f696-a82d-4183-860a-7d7e96a21bf4 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:37.219512 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-126c9b6c-e458-4622-b98c-3ca67a11c122 req-4343f696-a82d-4183-860a-7d7e96a21bf4 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:37.220122 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-126c9b6c-e458-4622-b98c-3ca67a11c122 req-4343f696-a82d-4183-860a-7d7e96a21bf4 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:37.234843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-126c9b6c-e458-4622-b98c-3ca67a11c122 req-4343f696-a82d-4183-860a-7d7e96a21bf4 service nova] Creating event network-vif-plugged:94e0438a-f4e0-4b1c-917c-2902573e08d8 for instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de on hv-cinder-86249 Oct 24 13:54:37.240829 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-126c9b6c-e458-4622-b98c-3ca67a11c122 req-4343f696-a82d-4183-860a-7d7e96a21bf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038776 Oct 24 13:54:37.241608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 626/1254] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:54:37.927142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:37.927785 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:37.934505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:37.934927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:37.935362 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:37.936054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:37.936507 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:37.936935 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:38.073936 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:38.084549 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-2df9bfb7-50ab-4199-a70f-ce7525d806e9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.162081 Oct 24 13:54:38.085200 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 629/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:37 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:39.110621 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:39.111895 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:39.121273 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:39.122083 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:39.123103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:39.124055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:39.125464 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:39.126086 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:39.311052 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:39.321695 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4b8e5a13-bdc1-40d0-827b-04b5a8bcb11b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1265 microversion: 2.1 time: 0.217311 Oct 24 13:54:39.322561 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 627/1256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:39 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:54:40.344580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:40.345360 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:40.352306 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:40.352413 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:40.352780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:40.353478 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:40.353931 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:40.354396 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:40.491282 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:40.499797 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-cb98ae23-fc48-4502-9449-f97ef5ecfd29 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1452 microversion: 2.1 time: 0.158932 Oct 24 13:54:40.500560 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 630/1257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:40 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:40.522659 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:54:40.523312 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:54:40.529864 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:40.530785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:40.531229 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:40.531931 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:40.532971 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:40.533408 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:40.668128 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:54:40.676533 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a2eeeca3-d37c-4ee1-9eda-24be46ea172e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1452 microversion: 2.1 time: 0.157595 Oct 24 13:54:40.677263 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 628/1258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:54:40 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:54:42.339505 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-9bf5b205-b41a-4d44-94e6-a730dd6ccdc7 req-bdc1787a-6557-45f5-82cf-fd94265fca4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afb1125-ca3f-42ed-9221-a0b71a20a2de", "tag": "94e0438a-f4e0-4b1c-917c-2902573e08d8"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:54:42.350642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9bf5b205-b41a-4d44-94e6-a730dd6ccdc7 req-bdc1787a-6557-45f5-82cf-fd94265fca4d service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:54:42.351123 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9bf5b205-b41a-4d44-94e6-a730dd6ccdc7 req-bdc1787a-6557-45f5-82cf-fd94265fca4d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:54:42.351545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9bf5b205-b41a-4d44-94e6-a730dd6ccdc7 req-bdc1787a-6557-45f5-82cf-fd94265fca4d service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:54:42.364128 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-9bf5b205-b41a-4d44-94e6-a730dd6ccdc7 req-bdc1787a-6557-45f5-82cf-fd94265fca4d service nova] Creating event network-changed:94e0438a-f4e0-4b1c-917c-2902573e08d8 for instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de on hv-cinder-86249 Oct 24 13:54:42.370562 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-9bf5b205-b41a-4d44-94e6-a730dd6ccdc7 req-bdc1787a-6557-45f5-82cf-fd94265fca4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Oct 24 13:54:42.371407 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 631/1259] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:57:04.870484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [101bc47d-1a4e-40f9-9013-b07b6a859090] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 13:57:04.871091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=7 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:04.871767 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=78 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:04.873177 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:57:04.873386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Mon Oct 24 13:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1/action (ip 10.222.0.20) !!! Oct 24 13:57:04.875313 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 13:57:04.875460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Mon Oct 24 13:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1/action (ip 10.222.0.20) !!! Oct 24 13:57:04.883054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:04.883579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:04.895308 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:04.895729 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:04.896170 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:04.896868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:04.897346 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:04.897791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:04.921421 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lazy-loading 'flavor' on Instance uuid b2dbc8ab-831e-4965-a638-f21178f93bb1 {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:57:04.991138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d3d2e3b1-9de6-4595-aae0-5c21ea41ce9a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "POST /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.122572 Oct 24 13:57:04.991769 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 629/1260] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:57:04 2022] POST /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:57:04.998847 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=7 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:04.999662 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=78 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:05.001293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 13:57:05.001569 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Mon Oct 24 13:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 (ip 10.222.0.20) !!! Oct 24 13:57:05.002795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 13:57:05.002917 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Mon Oct 24 13:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 (ip 10.222.0.20) !!! Oct 24 13:57:05.007690 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:05.008525 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:05.022807 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:05.023298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:05.023734 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:05.024448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:05.024914 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:05.025333 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:05.554251 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:05.562326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-7e1dd5cb-53ea-4cc7-87b9-b9a8ab79e29f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.565555 Oct 24 13:57:05.563084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 632/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:04 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:06.589910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:06.590660 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:06.599169 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO oslo.messaging._drivers.impl_rabbit [-] [101bc47d-1a4e-40f9-9013-b07b6a859090] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48646. Oct 24 13:57:06.604510 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:06.605370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:06.606143 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:06.607431 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:06.608248 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:06.609024 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:06.797659 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:06.805374 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9ec346ac-8c03-4c96-90e1-7914e73ffe58 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.221687 Oct 24 13:57:06.805941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 630/1262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:06 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:07.829153 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:07.829767 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:07.837159 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:07.837642 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:07.838079 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:07.838795 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:07.839252 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:07.839678 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:07.969370 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:07.977897 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e48b6938-8a47-4b78-8b03-66d225f81249 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.152602 Oct 24 13:57:07.978493 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 633/1263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:07 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:09.001577 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:09.002534 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:09.008951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:09.009428 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:09.009861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:09.010585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:09.011036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:09.011460 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:09.138119 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:09.145909 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-425feb15-c7fd-4c92-a217-c36b3413a334 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.148246 Oct 24 13:57:09.146563 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 631/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:08 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:10.170326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:10.170934 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:10.178391 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:10.178869 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:10.179296 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:10.180012 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:10.180474 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:10.180906 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:10.312030 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:10.320587 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3b2ffcb5-0c25-4ca7-9c4b-e2dbdaa9977d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.154429 Oct 24 13:57:10.321157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 634/1265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:10 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:11.343036 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:11.343652 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:11.350090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:11.350605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:11.351047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:11.351735 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:11.352193 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:11.352619 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:11.480108 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:11.487798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-08244596-6f11-4da5-a549-0749a9b867df tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.148668 Oct 24 13:57:11.488366 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 632/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:11 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:12.511499 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:12.512028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:12.519124 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:12.519565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:12.520001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:12.520694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:12.521432 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:12.521859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:12.652623 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:12.661332 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-106a7df5-0f77-47f7-88e9-a9f6a3564dd1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.153760 Oct 24 13:57:12.661893 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 635/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:12 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:13.684208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:13.684800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:13.691723 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:13.692221 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:13.692649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:13.693328 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:13.693771 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:13.694208 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:13.826939 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:13.835126 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8bbd5a2d-9447-41f1-a84e-550f1326029c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.154722 Oct 24 13:57:13.835693 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 633/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:13 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:14.858100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:14.858727 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:14.865242 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:14.865723 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:14.866157 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:14.866866 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:14.867317 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:14.867735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:14.998236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:15.006625 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6fe4c0f1-2dcc-4ea1-b866-d14c718f3f1d tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.152362 Oct 24 13:57:15.007188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 636/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:14 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:16.030256 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:16.031065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:16.037531 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:16.038011 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:16.038478 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:16.039162 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:16.039609 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:16.040025 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:16.170968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:16.179417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e29d4dd1-3449-4e5d-aed0-5c82d7733482 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.153107 Oct 24 13:57:16.179984 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 634/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:16 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:17.203283 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:17.203891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:17.211241 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:17.211930 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:17.212132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:17.212819 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:17.213262 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:17.213676 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:17.350458 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:17.358136 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-e6f01871-a067-44fd-b478-42449457a6fb tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.158712 Oct 24 13:57:17.358733 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 637/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:17 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:18.381861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:18.382498 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:18.388917 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:18.389402 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:18.389836 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:18.390585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:18.391039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:18.391459 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:18.458076 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1832203061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-519842543", "security_groups": [{"name": "tempest-secgroup-smoke-2089865704"}], "block_device_mapping_v2": [{"uuid": "8e2eef90-7c6e-4df5-a0b5-3379b0d3db4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0a27a795-3bd6-4937-8a2d-83219efd0aaa"}]}} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:18.527070 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:18.536595 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ed5a7c88-6f0d-4fba-a4c9-f0d0cf64e9d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.158544 Oct 24 13:57:18.537166 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 635/1272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:18 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:18.580557 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.network.neutron [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] validate_networks() for [('0a27a795-3bd6-4937-8a2d-83219efd0aaa', None, None, None, None, None)] {{(pid=125456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:57:18.950067 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Flavor limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:57:18.950532 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Image limits 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:57:18.951007 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Flavor pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:57:18.951447 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Image pref 0:0:0 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:57:18.951883 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.virt.hardware [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:57:18.961174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:18.961651 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:18.962084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:18.962837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:18.963290 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:18.963711 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:18.980049 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for project 5db8c3fdabf94498948055239da40ca0. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:57:18.984093 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.quota [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Getting quotas for user 568d031158744101a6bb339e51149ed2 and project 5db8c3fdabf94498948055239da40ca0. Resources: {'ram', 'instances', 'cores'} {{(pid=125456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:57:19.040636 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Going to run 1 instances... {{(pid=125456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:57:19.042799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e2eef90-7c6e-4df5-a0b5-3379b0d3db4d',volume_size=None,volume_type=None)] {{(pid=125456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:57:19.174596 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4fb32ee4-d1b0-4540-a6b5-b69491ebc77c tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720289 Oct 24 13:57:19.175519 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 638/1273] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 24 13:57:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:57:19.186603 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-475b16af-6306-4997-aff6-9c5d3a33fe82 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:19.187218 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-475b16af-6306-4997-aff6-9c5d3a33fe82 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:19.241608 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-475b16af-6306-4997-aff6-9c5d3a33fe82 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:19.248515 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-475b16af-6306-4997-aff6-9c5d3a33fe82 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1094 microversion: 2.1 time: 0.065808 Oct 24 13:57:19.249271 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 636/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:19 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:19.563225 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:19.563840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:19.571758 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:19.572181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:19.572649 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:19.573495 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:19.574093 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:19.574781 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:19.716659 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:19.725095 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9655335c-afba-4d68-bfb9-4b139b7bc0fd tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.166781 Oct 24 13:57:19.725764 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 639/1275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:19 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:20.275566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:20.277406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:20.288535 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:20.289351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:20.290076 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:20.291251 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:20.292044 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:20.293008 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:20.362132 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:20.371253 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-8eb44657-24e0-48fa-b45c-23c35b92ac46 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1210 microversion: 2.1 time: 0.102312 Oct 24 13:57:20.371834 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 637/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:20 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:20.749664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:20.750324 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:20.761048 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:20.761538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:20.761968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:20.762878 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:20.763326 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:20.763745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:21.131391 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:21.139194 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0a241c20-bf83-4197-84c6-90574452c225 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.393653 Oct 24 13:57:21.139772 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 640/1277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:20 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:21.395987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:21.396605 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:21.403339 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:21.403819 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:21.404252 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:21.404944 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:21.405651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:21.406072 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:21.554304 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:21.562897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-9f583b2c-e97f-4097-aa9e-617eaa38c97a tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.170731 Oct 24 13:57:21.564023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 638/1278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:21 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:22.164009 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:22.164617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:22.170972 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:22.171444 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:22.171896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:22.172571 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:22.173015 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:22.173429 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:22.301356 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:22.309023 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-fcb12cd6-158b-40c8-b83f-b2547d4cfb5f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.148804 Oct 24 13:57:22.309574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 641/1279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:22 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:22.586968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:22.587601 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:22.593992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:22.594511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:22.594951 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:22.595893 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:22.596351 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:22.596785 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:22.728116 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:22.736246 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-e0c78121-3e68-4d6c-ae01-7da8186fabb6 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.153214 Oct 24 13:57:22.737103 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 639/1280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:22 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:23.006787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-0be74d79-7709-473e-97f0-71d646c48ba7 req-12237545-8077-417e-aef7-2ae048612456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e272a0e-fe63-437d-b175-d66b71b7433c", "tag": "9139bb70-6fd7-4398-a76e-1d5e7f098d5a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:23.016740 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0be74d79-7709-473e-97f0-71d646c48ba7 req-12237545-8077-417e-aef7-2ae048612456 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.018097 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0be74d79-7709-473e-97f0-71d646c48ba7 req-12237545-8077-417e-aef7-2ae048612456 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.019064 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-0be74d79-7709-473e-97f0-71d646c48ba7 req-12237545-8077-417e-aef7-2ae048612456 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.030790 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-0be74d79-7709-473e-97f0-71d646c48ba7 req-12237545-8077-417e-aef7-2ae048612456 service nova] Creating event network-changed:9139bb70-6fd7-4398-a76e-1d5e7f098d5a for instance 6e272a0e-fe63-437d-b175-d66b71b7433c on hv-cinder-86249 Oct 24 13:57:23.037958 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-0be74d79-7709-473e-97f0-71d646c48ba7 req-12237545-8077-417e-aef7-2ae048612456 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034793 Oct 24 13:57:23.038941 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 642/1281] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:57:23.332800 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:23.333393 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:23.339250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.339727 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.340181 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.341047 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.341317 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.341728 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.468333 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:23.476009 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-d9cb6e81-b148-4b85-8fb1-3524d4394f8b tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1569 microversion: 2.1 time: 0.147943 Oct 24 13:57:23.476581 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 640/1282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:23 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:23.499664 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:23.500288 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:23.507137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.507617 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.508051 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.508737 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.509188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.509609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.539421 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125456) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:57:23.612675 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6e328934-32b2-4a13-b21d-d3e2a427b852 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "POST /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.117609 Oct 24 13:57:23.613586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 643/1283] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 24 13:57:23 2022] POST /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:57:23.621683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:23.622992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:23.631628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.631628 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.632023 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.632704 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.633306 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.633734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.760745 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:23.761131 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:23.767118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.767605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.768039 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.768880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:23.769338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:23.769759 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:23.777870 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:23.787010 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-148356d6-7367-4574-abde-868d2150c354 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1517 microversion: 2.1 time: 0.169230 Oct 24 13:57:23.788165 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 641/1284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:23 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:23.917406 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:23.926611 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-a5b1f970-d628-4118-b371-44904c717c21 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.171287 Oct 24 13:57:23.927181 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 644/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:23 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:24.811842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:24.812452 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:24.819091 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:24.819570 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:24.820000 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:24.820688 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:24.821138 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:24.821572 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:24.949877 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:24.950475 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:24.956863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:24.957578 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:24.958222 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:24.958386 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:24.958937 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:24.959396 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:24.959934 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:24.972935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-54461913-80fa-44e4-ac33-507a4b97f4d7 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1519 microversion: 2.1 time: 0.164860 Oct 24 13:57:24.973560 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 642/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:24 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:25.107401 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:25.115479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-67e68cd4-17c6-486a-9a3a-082cd19c8aef tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.169466 Oct 24 13:57:25.116118 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 645/1287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:24 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:25.997404 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:25.998222 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:26.005956 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:26.006376 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:26.006820 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:26.007527 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:26.008296 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:26.008551 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:26.131580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-1bf11662-669b-4a23-8056-69fee424cbad req-3a07097d-bcf4-47dd-87b3-aa4af0570f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "name": "network-vif-unplugged", "status": "completed", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:26.148461 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-1bf11662-669b-4a23-8056-69fee424cbad req-3a07097d-bcf4-47dd-87b3-aa4af0570f92 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:26.149084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-1bf11662-669b-4a23-8056-69fee424cbad req-3a07097d-bcf4-47dd-87b3-aa4af0570f92 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:26.149615 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-1bf11662-669b-4a23-8056-69fee424cbad req-3a07097d-bcf4-47dd-87b3-aa4af0570f92 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:26.162651 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:26.163112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-1bf11662-669b-4a23-8056-69fee424cbad req-3a07097d-bcf4-47dd-87b3-aa4af0570f92 service nova] Creating event network-vif-unplugged:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:57:26.168622 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-1bf11662-669b-4a23-8056-69fee424cbad req-3a07097d-bcf4-47dd-87b3-aa4af0570f92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045053 Oct 24 13:57:26.169648 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 646/1288] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:57:26.173694 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-efb3ec8e-a57d-476e-9c7d-d19f7237a91a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.180483 Oct 24 13:57:26.174504 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 643/1289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:25 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:26.184459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:26.185149 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:26.191840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:26.192449 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:26.192883 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:26.193580 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:26.194073 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:26.194453 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:26.403756 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:26.411800 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-818cee6d-3878-4b3e-835e-1786ce405663 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.240924 Oct 24 13:57:26.412380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 647/1290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:26 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:27.196846 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:27.197495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:27.204073 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:27.204558 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:27.204992 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:27.205702 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:27.206160 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:27.206606 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:27.225227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:27.337734 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:27.346090 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-437ad400-2696-485c-a53e-ea5f72a9e863 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.152605 Oct 24 13:57:27.346682 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 644/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:27 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:27.434430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:27.434963 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:27.441497 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:27.441978 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:27.442433 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:27.443121 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:27.443574 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:27.443997 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:27.571206 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:27.578757 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-836264c5-aa71-4e13-baa3-8f683959ad97 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.148281 Oct 24 13:57:27.579318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 648/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:27 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:28.368838 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:28.369457 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:28.375897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:28.376375 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:28.377507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:28.378257 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:28.378719 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:28.379140 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:28.511228 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:28.518941 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cd0b72fa-730a-480f-93f1-03cc91703f3f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.153948 Oct 24 13:57:28.519507 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 645/1293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:28 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:28.601248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:28.601863 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:28.608298 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:28.608778 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:28.609213 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:28.609900 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:28.610380 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:28.610805 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:28.630345 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:28.744150 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:28.751762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-8b94070f-8a95-427f-a9dc-6e2a379cf51b tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.154356 Oct 24 13:57:28.752392 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 649/1294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:28 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:29.543054 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:29.543663 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:29.545517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell0:SELECT=2 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:29.551270 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:29.551745 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:29.552174 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:29.552851 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:29.553298 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:29.553711 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:29.681262 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:29.689048 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-95c7b721-d9ce-4926-8aa9-e2c3267d1b1a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.149853 Oct 24 13:57:29.690292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 646/1295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:29 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:29.775485 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:29.776146 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:29.778340 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=2 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:29.779126 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell0:SELECT=6 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:29.786363 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:29.786849 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:29.787313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:29.788029 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:29.788469 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:29.788891 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:29.920459 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:29.928754 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-c09df9c0-fe43-4019-b3bd-19fd5d47c9b5 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.157723 Oct 24 13:57:29.929318 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 650/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:29 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:30.713433 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:30.714077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:30.720805 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:30.721614 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:30.722055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:30.722770 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:30.723221 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:30.723640 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:30.852489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:30.860077 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0f058fb7-742c-4e16-801b-94505b681065 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.150764 Oct 24 13:57:30.860637 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 647/1297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:30 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:30.951927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:30.952658 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:30.959613 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:30.960094 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:30.960526 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:30.961214 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:30.961661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:30.962083 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:31.091084 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:31.098912 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-589cbdc3-98d6-407c-bc00-4531eb0cf349 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.150772 Oct 24 13:57:31.099479 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 651/1298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:30 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:31.883303 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:31.883898 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:31.890285 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:31.890757 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:31.891183 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:31.891861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:31.892305 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:31.893216 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:32.027813 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:32.036573 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-fbe20e54-a88f-41dd-9fb0-4d026216089e tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.157126 Oct 24 13:57:32.037286 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 648/1299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:31 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:32.120993 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:32.121609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:32.128291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:32.128773 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:32.129209 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:32.129907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:32.130387 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:32.130810 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:32.272081 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:32.279763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3511d6cf-39e3-404b-965c-0e87b6a83784 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.162714 Oct 24 13:57:32.280570 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 652/1300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:32 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:33.059868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:33.060479 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:33.067039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:33.067514 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:33.067947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:33.068634 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:33.069085 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:33.069508 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:33.199055 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:33.206879 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-1d3fdb98-4071-429a-8739-8d2cf41a5f65 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.150883 Oct 24 13:57:33.207446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 649/1301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:33 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:33.303556 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:33.304165 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:33.310586 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:33.311004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:33.311430 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:33.312106 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:33.312551 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:33.312968 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:33.443203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:33.450763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-4c9a1fae-92d7-44ac-a70e-cd79072603a1 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.152034 Oct 24 13:57:33.451325 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 653/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:33 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:34.230975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:34.231624 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:34.238379 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:34.239088 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:34.239525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:34.240225 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:34.240683 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:34.241161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:34.383924 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:34.393265 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-cdd3075b-3e45-4619-b66c-96507b47dec1 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.165500 Oct 24 13:57:34.393967 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 650/1303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:34 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:57:34.424111 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-789c3c9b-05af-4574-9721-7e324c9a0893 req-95d48ca1-a7fa-45ae-90ed-a9252f0ef97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e272a0e-fe63-437d-b175-d66b71b7433c", "name": "network-vif-plugged", "status": "completed", "tag": "9139bb70-6fd7-4398-a76e-1d5e7f098d5a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:34.448257 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-789c3c9b-05af-4574-9721-7e324c9a0893 req-95d48ca1-a7fa-45ae-90ed-a9252f0ef97e service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:34.448710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-789c3c9b-05af-4574-9721-7e324c9a0893 req-95d48ca1-a7fa-45ae-90ed-a9252f0ef97e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:34.449132 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-789c3c9b-05af-4574-9721-7e324c9a0893 req-95d48ca1-a7fa-45ae-90ed-a9252f0ef97e service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:34.461236 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-789c3c9b-05af-4574-9721-7e324c9a0893 req-95d48ca1-a7fa-45ae-90ed-a9252f0ef97e service nova] Creating event network-vif-plugged:9139bb70-6fd7-4398-a76e-1d5e7f098d5a for instance 6e272a0e-fe63-437d-b175-d66b71b7433c on hv-cinder-86249 Oct 24 13:57:34.466156 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-789c3c9b-05af-4574-9721-7e324c9a0893 req-95d48ca1-a7fa-45ae-90ed-a9252f0ef97e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117555 Oct 24 13:57:34.467245 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 654/1304] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:57:34.473301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:34.474020 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:34.480109 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:34.480670 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:34.481164 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:34.481987 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:34.482548 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:34.483035 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:34.618318 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:34.625989 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-4ad90089-e39d-492f-9b96-800ca5c1df53 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.156950 Oct 24 13:57:34.626593 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 651/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:34 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:35.418090 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:35.418859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:35.420801 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:35.427630 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:35.428188 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:35.428533 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:35.429226 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:35.429679 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:35.430102 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:35.560231 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:35.568033 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9078b20e-494c-4223-ae22-5723487b6fbc tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.154547 Oct 24 13:57:35.568598 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 655/1306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:35 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:35.649579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:35.650209 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:35.652496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=49 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:57:35.658791 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:35.659275 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:35.659714 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:35.660403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:35.660857 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:35.661309 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:35.790373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:35.797947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-570f189b-5f05-4380-971d-2cedc3b58ac2 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1266 microversion: 2.1 time: 0.152265 Oct 24 13:57:35.798555 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 652/1307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:35 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:36.480028 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-163571a9-c422-495e-8385-ea6e2fae60a3 req-361d6c5c-6861-493e-a418-6490014a648c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "name": "network-vif-plugged", "status": "completed", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:36.490232 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-163571a9-c422-495e-8385-ea6e2fae60a3 req-361d6c5c-6861-493e-a418-6490014a648c service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:36.490710 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-163571a9-c422-495e-8385-ea6e2fae60a3 req-361d6c5c-6861-493e-a418-6490014a648c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:36.491137 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-163571a9-c422-495e-8385-ea6e2fae60a3 req-361d6c5c-6861-493e-a418-6490014a648c service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:36.502600 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-163571a9-c422-495e-8385-ea6e2fae60a3 req-361d6c5c-6861-493e-a418-6490014a648c service nova] Creating event network-vif-plugged:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:57:36.507270 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-163571a9-c422-495e-8385-ea6e2fae60a3 req-361d6c5c-6861-493e-a418-6490014a648c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 Oct 24 13:57:36.507841 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 656/1308] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:57:36.591796 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:36.592436 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:36.598585 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:36.599056 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:36.599484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:36.600167 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:36.600611 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:36.601026 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:36.737670 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:36.746364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-f346c32d-09cc-42d7-8745-aefede5eeac6 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1575 microversion: 2.1 time: 0.158438 Oct 24 13:57:36.746936 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 653/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:36 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:36.821160 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:36.821859 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:36.827986 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:36.828465 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:36.828896 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:36.829572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:36.830061 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:36.830828 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:36.966319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:36.974838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-f8408a5f-19f0-4782-a137-86d6a798d06e tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1454 microversion: 2.1 time: 0.158005 Oct 24 13:57:36.975398 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 657/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:36 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:36.997406 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:36.997872 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:37.003905 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:37.004373 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:37.004799 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:37.005484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:37.005929 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:37.006385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:37.134149 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:37.141776 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ad3a9124-98a4-4796-a4c4-00c3d99b8d61 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1454 microversion: 2.1 time: 0.148362 Oct 24 13:57:37.142855 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 654/1311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:36 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:37.770448 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:57:37.771260 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:57:37.777880 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:37.778337 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:37.778763 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:37.780253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:37.780253 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:37.780724 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:37.999799 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:57:38.013536 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-3cb2b855-1b94-441f-9f0c-02d26aa1018c tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1562 microversion: 2.1 time: 0.247226 Oct 24 13:57:38.014135 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 658/1312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:57:37 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:57:38.905783 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-6ac2f5ef-c99b-45c6-a1a5-a1cad1661e4e req-b7ff77f4-4847-44ff-a743-6abcd4c90c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e272a0e-fe63-437d-b175-d66b71b7433c", "tag": "9139bb70-6fd7-4398-a76e-1d5e7f098d5a"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:57:38.916739 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-6ac2f5ef-c99b-45c6-a1a5-a1cad1661e4e req-b7ff77f4-4847-44ff-a743-6abcd4c90c30 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:57:38.917230 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-6ac2f5ef-c99b-45c6-a1a5-a1cad1661e4e req-b7ff77f4-4847-44ff-a743-6abcd4c90c30 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:57:38.917686 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-6ac2f5ef-c99b-45c6-a1a5-a1cad1661e4e req-b7ff77f4-4847-44ff-a743-6abcd4c90c30 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:57:38.929282 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-6ac2f5ef-c99b-45c6-a1a5-a1cad1661e4e req-b7ff77f4-4847-44ff-a743-6abcd4c90c30 service nova] Creating event network-changed:9139bb70-6fd7-4398-a76e-1d5e7f098d5a for instance 6e272a0e-fe63-437d-b175-d66b71b7433c on hv-cinder-86249 Oct 24 13:57:38.934293 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-6ac2f5ef-c99b-45c6-a1a5-a1cad1661e4e req-b7ff77f4-4847-44ff-a743-6abcd4c90c30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032596 Oct 24 13:57:38.934922 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 655/1313] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:59:15.384338 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ea742db-41ce-4a6d-a898-ac55bdb9f152] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 13:59:15.386228 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=7 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:15.387321 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=7 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:15.388013 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=48 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:15.388389 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=64 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:15.393203 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:15.393769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:15.403879 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:15.404359 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:15.404994 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:15.405947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:15.406634 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:15.407056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:15.433001 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Going to try to terminate instance {{(pid=125456) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:59:15.466415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-ace26da8-0404-4008-aac7-be5c793f5b5c req-ba6579bd-1ddb-4ee3-bd45-d1bd786765e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:59:15.476945 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ace26da8-0404-4008-aac7-be5c793f5b5c req-ba6579bd-1ddb-4ee3-bd45-d1bd786765e9 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:15.477691 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ace26da8-0404-4008-aac7-be5c793f5b5c req-ba6579bd-1ddb-4ee3-bd45-d1bd786765e9 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:15.478385 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-ace26da8-0404-4008-aac7-be5c793f5b5c req-ba6579bd-1ddb-4ee3-bd45-d1bd786765e9 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:15.490843 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-ace26da8-0404-4008-aac7-be5c793f5b5c req-ba6579bd-1ddb-4ee3-bd45-d1bd786765e9 service nova] Creating event network-changed:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:59:15.496482 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-ace26da8-0404-4008-aac7-be5c793f5b5c req-ba6579bd-1ddb-4ee3-bd45-d1bd786765e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111891 Oct 24 13:59:15.497295 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 656/1314] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:59:15.521492 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-051bc21f-0c94-495c-8e48-3c6c654a341a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 204 len: 0 microversion: 2.1 time: 0.138991 Oct 24 13:59:15.522437 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 659/1315] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:59:15 2022] DELETE /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:59:15.533364 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:15.534081 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:15.544933 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:15.545528 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:15.546038 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:15.547161 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:15.547639 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:15.548065 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:15.696152 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:15.704079 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-a7a833ff-bbdb-4279-b7ff-b2ee40c9b6a0 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.175278 Oct 24 13:59:15.704646 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 657/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:15 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:16.729129 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:16.729809 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:16.737702 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:16.738204 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:16.738852 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:16.739565 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:16.740021 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:16.740437 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:16.749838 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ea742db-41ce-4a6d-a898-ac55bdb9f152] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48906. Oct 24 13:59:16.902054 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:16.909995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9816f6e6-8a0d-41e6-9eee-b100654e1661 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1568 microversion: 2.1 time: 0.185159 Oct 24 13:59:16.910589 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 660/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:16 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:17.794975 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [req-951f5d14-8f70-45b8-836e-bd7fe5e46507 req-11f0eb13-07e1-4ae6-a853-a796e97d57c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dbc8ab-831e-4965-a638-f21178f93bb1", "name": "network-vif-deleted", "tag": "3e5d80e5-34e6-41c5-b010-ea9cdaf36d76"}]} {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:59:17.807861 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-951f5d14-8f70-45b8-836e-bd7fe5e46507 req-11f0eb13-07e1-4ae6-a853-a796e97d57c0 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:17.808417 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-951f5d14-8f70-45b8-836e-bd7fe5e46507 req-11f0eb13-07e1-4ae6-a853-a796e97d57c0 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:17.808910 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [req-951f5d14-8f70-45b8-836e-bd7fe5e46507 req-11f0eb13-07e1-4ae6-a853-a796e97d57c0 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:17.822940 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.compute.server_external_events [req-951f5d14-8f70-45b8-836e-bd7fe5e46507 req-11f0eb13-07e1-4ae6-a853-a796e97d57c0 service nova] Creating event network-vif-deleted:3e5d80e5-34e6-41c5-b010-ea9cdaf36d76 for instance b2dbc8ab-831e-4965-a638-f21178f93bb1 on hv-cinder-86249 Oct 24 13:59:17.828049 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [req-951f5d14-8f70-45b8-836e-bd7fe5e46507 req-11f0eb13-07e1-4ae6-a853-a796e97d57c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036785 Oct 24 13:59:17.829301 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 658/1318] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:59:17.934308 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:17.934946 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:17.941319 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:17.941792 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:17.942255 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:17.943041 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:17.943490 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:17.943907 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:18.006193 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480fb668fa446debc095215f4d55928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8cb8c044ad40a09528d3e1248642a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:18.013837 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-ecd5e655-4156-4549-a236-a833eaef5990 tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 200 len: 1218 microversion: 2.1 time: 0.083621 Oct 24 13:59:18.014427 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 661/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:17 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:19.038111 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:19.038873 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] [instance: b2dbc8ab-831e-4965-a638-f21178f93bb1] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:19.045415 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:19.045897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:19.046370 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:19.047063 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:19.047517 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:19.047942 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:19.061798 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] HTTP exception thrown: Instance b2dbc8ab-831e-4965-a638-f21178f93bb1 could not be found. Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Request method failure captured: Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 HTTP/1.1 Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpjXoNvQHCD8yvPCNUdfd9G3zzGV_EVp1OFrW9uL47mKsNbIMrvR66KaJnuRFXbLJ33iwc5RgZskYxHKHQXFuAXRab9wVw5jhTE4eEyokeBFe9CWSuC5GSKXDOYW1agUzgQA5w6Jf0QmlJuCHGev2DdYNO40jOQDkeupOJ1L7Cnmenc Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: fb8cb8c044ad40a09528d3e1248642a2 Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-TestShelveInstance-1000629546 Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:59:19.063483 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb8cb8c044ad40a09528d3e1248642a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb8cb8c044ad40a09528d3e1248642a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb8cb8c044ad40a09528d3e1248642a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb8cb8c044ad40a09528d3e1248642a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-TestShelveInstance-1000629546 Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: fb8cb8c044ad40a09528d3e1248642a2 Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-TestShelveInstance-1000629546 Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-TestShelveInstance-1000629546-project Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: d480fb668fa446debc095215f4d55928 Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-TestShelveInstance-1000629546-project Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance b2dbc8ab-831e-4965-a638-f21178f93bb1 could not be found. Oct 24 13:59:19.065311 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': 'b2dbc8ab-831e-4965-a638-f21178f93bb1'} Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2dbc8ab-831e-4965-a638-f21178f93bb1 could not be found. Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:59:19.066566 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2dbc8ab-831e-4965-a638-f21178f93bb1 could not be found. Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2dbc8ab-831e-4965-a638-f21178f93bb1 could not be found. Oct 24 13:59:19.068973 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:19.070790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Returning 404 to user: Instance b2dbc8ab-831e-4965-a638-f21178f93bb1 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:59:19.070790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-c96fb826-f725-4ef4-b765-0826ccdd8d7f tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1" status: 404 len: 111 microversion: 2.1 time: 0.031588 Oct 24 13:59:19.070790 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 659/1320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:19 2022] GET /compute/v2.1/servers/b2dbc8ab-831e-4965-a638-f21178f93bb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:59:19.226545 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-0d666257-f87f-429a-ae5f-49eef8f28a8a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] Calling method '.version_select at 0x7f8dc23f6670>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:19.251171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-0d666257-f87f-429a-ae5f-49eef8f28a8a tempest-TestShelveInstance-1000629546 tempest-TestShelveInstance-1000629546-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-102228527" status: 202 len: 0 microversion: 2.1 time: 0.028708 Oct 24 13:59:19.251762 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 662/1321] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 24 13:59:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-102228527 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:59:39.755039 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:39.755588 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:39.755964 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:39.756071 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG dbcounter [-] [125456] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:39.758461 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_api:SELECT=8 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:39.759272 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG dbcounter [-] [125457] Writing DB stats nova_cell1:SELECT=12 {{(pid=125457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:59:39.761310 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-9a51c95d-b86c-4558-afdf-7386767ce2e1 req-13f4414d-025b-4ac9-9b0d-9f80ec772dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e272a0e-fe63-437d-b175-d66b71b7433c", "tag": "9139bb70-6fd7-4398-a76e-1d5e7f098d5a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:59:39.764954 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:39.765579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:39.766100 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:39.767379 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:39.767928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:39.768544 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:39.774477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9a51c95d-b86c-4558-afdf-7386767ce2e1 req-13f4414d-025b-4ac9-9b0d-9f80ec772dca service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:39.774477 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9a51c95d-b86c-4558-afdf-7386767ce2e1 req-13f4414d-025b-4ac9-9b0d-9f80ec772dca service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:39.774873 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-9a51c95d-b86c-4558-afdf-7386767ce2e1 req-13f4414d-025b-4ac9-9b0d-9f80ec772dca service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:39.788776 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-9a51c95d-b86c-4558-afdf-7386767ce2e1 req-13f4414d-025b-4ac9-9b0d-9f80ec772dca service nova] Creating event network-changed:9139bb70-6fd7-4398-a76e-1d5e7f098d5a for instance 6e272a0e-fe63-437d-b175-d66b71b7433c on hv-cinder-86249 Oct 24 13:59:39.794066 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-9a51c95d-b86c-4558-afdf-7386767ce2e1 req-13f4414d-025b-4ac9-9b0d-9f80ec772dca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040303 Oct 24 13:59:39.795227 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 663/1322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:59:39.809182 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:59:39.894636 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-656acc64-5fe3-4d84-bb72-c7276d851974 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 204 len: 0 microversion: 2.1 time: 0.143510 Oct 24 13:59:39.904960 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:39.906559 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:39.909874 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 660/1323] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:59:39 2022] DELETE /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:59:39.913995 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:39.914511 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:39.914947 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:39.915646 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:39.916100 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:39.916521 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:40.068927 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:40.076627 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-66cd65ba-6f7e-49cc-ad83-fbb4c1668612 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1578 microversion: 2.1 time: 0.175892 Oct 24 13:59:40.077201 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 664/1324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:39 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:41.101842 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:41.102590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:41.108860 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:41.109335 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:41.109761 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:41.110481 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:41.110928 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:41.111344 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:41.247398 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:41.255511 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-032531b9-3884-4ed0-a473-4fc08a7d4149 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1578 microversion: 2.1 time: 0.158550 Oct 24 13:59:41.256171 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 661/1325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:41 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:41.998687 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-b62a0151-ac39-405c-b497-b776aad37cfe req-a01c4134-5972-463e-a117-7b68a4dc9a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e272a0e-fe63-437d-b175-d66b71b7433c", "name": "network-vif-deleted", "tag": "9139bb70-6fd7-4398-a76e-1d5e7f098d5a"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:59:42.010291 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-b62a0151-ac39-405c-b497-b776aad37cfe req-a01c4134-5972-463e-a117-7b68a4dc9a26 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:42.010769 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-b62a0151-ac39-405c-b497-b776aad37cfe req-a01c4134-5972-463e-a117-7b68a4dc9a26 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:42.011198 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-b62a0151-ac39-405c-b497-b776aad37cfe req-a01c4134-5972-463e-a117-7b68a4dc9a26 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:42.023605 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-b62a0151-ac39-405c-b497-b776aad37cfe req-a01c4134-5972-463e-a117-7b68a4dc9a26 service nova] Creating event network-vif-deleted:9139bb70-6fd7-4398-a76e-1d5e7f098d5a for instance 6e272a0e-fe63-437d-b175-d66b71b7433c on hv-cinder-86249 Oct 24 13:59:42.028682 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-b62a0151-ac39-405c-b497-b776aad37cfe req-a01c4134-5972-463e-a117-7b68a4dc9a26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Oct 24 13:59:42.029285 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 665/1326] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:59:42.279367 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:42.280381 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:42.287897 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:42.288398 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:42.289014 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:42.289935 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:42.290496 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:42.291141 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:42.326465 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:42.327005 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:42.327446 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:42.327899 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.objects.instance [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lazy-loading 'fault' on Instance uuid 6e272a0e-fe63-437d-b175-d66b71b7433c {{(pid=125457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:59:42.374426 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:42.383579 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-0af8402a-c850-42d3-b24e-fbb2bb63cd86 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 200 len: 1230 microversion: 2.1 time: 0.108261 Oct 24 13:59:42.384148 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 662/1327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:42 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:43.408426 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:43.409047 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 6e272a0e-fe63-437d-b175-d66b71b7433c] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:43.415673 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:43.416144 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:43.416572 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:43.417248 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:43.417694 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:43.418112 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:43.431708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] HTTP exception thrown: Instance 6e272a0e-fe63-437d-b175-d66b71b7433c could not be found. Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Request method failure captured: Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c HTTP/1.1 Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpg5jLNWLF5zCjjI4FlCkKPXiNGun0bLWVlW1l03eq0VEV0srLt-gBBu2UYuJYVacFm9PAgAJ6xeqBJmnhQ9KBJcC190BRWk3_K7e0M6KBedkMJyL3rr93a4LtB0D5kPDEroFwxkt9w9KBuBwReIL2vagYWAw0zxAcmR8vHfuOQUpKw Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:59:43.433293 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5db8c3fdabf94498948055239da40ca0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 568d031158744101a6bb339e51149ed2 Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 6e272a0e-fe63-437d-b175-d66b71b7433c could not be found. Oct 24 13:59:43.435004 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '6e272a0e-fe63-437d-b175-d66b71b7433c'} Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e272a0e-fe63-437d-b175-d66b71b7433c could not be found. Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:59:43.436085 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e272a0e-fe63-437d-b175-d66b71b7433c could not be found. Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e272a0e-fe63-437d-b175-d66b71b7433c could not be found. Oct 24 13:59:43.437984 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:43.439609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Returning 404 to user: Instance 6e272a0e-fe63-437d-b175-d66b71b7433c could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:59:43.439609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-60048c8c-6b05-45c4-b2d2-d75e23dfe4bb tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c" status: 404 len: 111 microversion: 2.1 time: 0.031355 Oct 24 13:59:43.439609 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 666/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:43 2022] GET /compute/v2.1/servers/6e272a0e-fe63-437d-b175-d66b71b7433c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:59:46.745881 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:46.746499 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:46.748752 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-d7df652a-5925-43bd-b5f9-0623487d3ce5 req-5329d584-df05-4588-a294-307f66a18444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afb1125-ca3f-42ed-9221-a0b71a20a2de", "tag": "94e0438a-f4e0-4b1c-917c-2902573e08d8"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:59:46.752744 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:46.753220 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:46.753649 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:46.754429 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:46.754878 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:46.755292 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:46.758911 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d7df652a-5925-43bd-b5f9-0623487d3ce5 req-5329d584-df05-4588-a294-307f66a18444 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:46.759452 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d7df652a-5925-43bd-b5f9-0623487d3ce5 req-5329d584-df05-4588-a294-307f66a18444 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:46.760110 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-d7df652a-5925-43bd-b5f9-0623487d3ce5 req-5329d584-df05-4588-a294-307f66a18444 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:46.772190 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-d7df652a-5925-43bd-b5f9-0623487d3ce5 req-5329d584-df05-4588-a294-307f66a18444 service nova] Creating event network-changed:94e0438a-f4e0-4b1c-917c-2902573e08d8 for instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de on hv-cinder-86249 Oct 24 13:59:46.777378 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-d7df652a-5925-43bd-b5f9-0623487d3ce5 req-5329d584-df05-4588-a294-307f66a18444 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032409 Oct 24 13:59:46.777975 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 667/1329] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:59:46.782022 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Going to try to terminate instance {{(pid=125457) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:59:46.868196 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-ba913ea3-8995-40ef-b9ed-9c9689ace8f3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 204 len: 0 microversion: 2.1 time: 0.125002 Oct 24 13:59:46.872955 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 663/1330] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:59:46 2022] DELETE /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:59:46.878661 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:46.879439 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:46.885735 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:46.886267 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:46.886708 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:46.887410 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:46.887865 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:46.888484 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:47.122712 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.policy [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125456) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:47.133169 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-21453134-8269-4653-9506-d64517a78d19 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1577 microversion: 2.1 time: 0.258868 Oct 24 13:59:47.133902 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 668/1331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:46 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1577 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:48.158484 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:48.159227 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:48.165550 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:48.166030 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:48.166495 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:48.167187 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:48.167642 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:48.168067 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:48.233107 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.policy [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568d031158744101a6bb339e51149ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8c3fdabf94498948055239da40ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125457) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:59:48.242376 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-18dd799f-2d05-4fe8-8b68-9880029bf8b3 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 200 len: 1224 microversion: 2.1 time: 0.088365 Oct 24 13:59:48.242947 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 664/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:48 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:59:48.792468 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [req-362994be-f787-4393-85a7-ab704005a3bb req-56120691-00b0-4790-96fa-fa52620bfc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afb1125-ca3f-42ed-9221-a0b71a20a2de", "name": "network-vif-deleted", "tag": "94e0438a-f4e0-4b1c-917c-2902573e08d8"}]} {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:59:48.802334 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-362994be-f787-4393-85a7-ab704005a3bb req-56120691-00b0-4790-96fa-fa52620bfc93 service nova] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:48.802803 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-362994be-f787-4393-85a7-ab704005a3bb req-56120691-00b0-4790-96fa-fa52620bfc93 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:48.803230 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [req-362994be-f787-4393-85a7-ab704005a3bb req-56120691-00b0-4790-96fa-fa52620bfc93 service nova] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:48.813870 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.compute.server_external_events [req-362994be-f787-4393-85a7-ab704005a3bb req-56120691-00b0-4790-96fa-fa52620bfc93 service nova] Creating event network-vif-deleted:94e0438a-f4e0-4b1c-917c-2902573e08d8 for instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de on hv-cinder-86249 Oct 24 13:59:48.819142 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [req-362994be-f787-4393-85a7-ab704005a3bb req-56120691-00b0-4790-96fa-fa52620bfc93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030334 Oct 24 13:59:48.819706 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 669/1333] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 24 13:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:59:49.264795 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:49.265405 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 1afb1125-ca3f-42ed-9221-a0b71a20a2de] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:49.272489 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:49.272968 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:49.273409 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:49.274099 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:49.274597 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:49.275002 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:49.289212 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] HTTP exception thrown: Instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de could not be found. Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Request method failure captured: Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de HTTP/1.1 Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpg5jLNWLF5zCjjI4FlCkKPXiNGun0bLWVlW1l03eq0VEV0srLt-gBBu2UYuJYVacFm9PAgAJ6xeqBJmnhQ9KBJcC190BRWk3_K7e0M6KBedkMJyL3rr93a4LtB0D5kPDEroFwxkt9w9KBuBwReIL2vagYWAw0zxAcmR8vHfuOQUpKw Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:59:49.290868 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5db8c3fdabf94498948055239da40ca0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 568d031158744101a6bb339e51149ed2 Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de could not be found. Oct 24 13:59:49.292592 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '1afb1125-ca3f-42ed-9221-a0b71a20a2de'} Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de could not be found. Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:59:49.293590 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de could not be found. Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de could not be found. Oct 24 13:59:49.295268 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.296751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Returning 404 to user: Instance 1afb1125-ca3f-42ed-9221-a0b71a20a2de could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:59:49.296751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-23b41bce-ba82-495e-8df2-94dc84c238c9 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de" status: 404 len: 111 microversion: 2.1 time: 0.031314 Oct 24 13:59:49.296751 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 665/1334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:49 2022] GET /compute/v2.1/servers/1afb1125-ca3f-42ed-9221-a0b71a20a2de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:59:49.733313 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:49.733840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.compute.api [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125456) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:49.740538 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:49.741019 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:49.741460 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:49.742155 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:49.742631 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:49.743056 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG oslo_concurrency.lockutils [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:49.758840 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.wsgi [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] HTTP exception thrown: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Request method failure captured: Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: request: DELETE /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 HTTP/1.1 Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept: application/json Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Accept-Encoding: identity Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Connection: close Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Length: 0 Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Content-Type: application/json Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Host: 10.222.0.20 Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: Openstack-System-Scope: None Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: User-Agent: python-urllib3/1.26.12 Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Auth-Token: gAAAAABjVpg5jLNWLF5zCjjI4FlCkKPXiNGun0bLWVlW1l03eq0VEV0srLt-gBBu2UYuJYVacFm9PAgAJ6xeqBJmnhQ9KBJcC190BRWk3_K7e0M6KBedkMJyL3rr93a4LtB0D5kPDEroFwxkt9w9KBuBwReIL2vagYWAw0zxAcmR8vHfuOQUpKw Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Id: None Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Domain-Name: None Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Identity-Status: Confirmed Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Is-Admin-Project: True Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Id: default Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Domain-Name: Default Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Project-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Role: member,reader Oct 24 13:59:49.760780 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Roles: member,reader Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5db8c3fdabf94498948055239da40ca0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-Tenant-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Id: default Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Domain-Name: Default Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Id: 568d031158744101a6bb339e51149ed2 Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: X-User-Name: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: method: > Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: exception: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.762530 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: action_args: {'id': '96cda293-d706-482f-acba-625c087884e9'} Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:59:49.763581 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.765171 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.766990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Returning 404 to user: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. {{(pid=125456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:59:49.766990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-9b3d7b49-1219-43de-947c-227ac6ab3af0 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 404 len: 111 microversion: 2.1 time: 0.033529 Oct 24 13:59:49.766990 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 670/1335] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 24 13:59:49 2022] DELETE /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:59:49.772656 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '>' {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:49.773281 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.compute.api [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] [instance: 96cda293-d706-482f-acba-625c087884e9] Fetching instance by UUID {{(pid=125457) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:59:49.779250 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:49.779721 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:49.780396 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:49.781082 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Acquiring lock "b1e20d1c-cda7-4a62-9810-539755b5196c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:59:49.781530 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:59:49.781948 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG oslo_concurrency.lockutils [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Lock "b1e20d1c-cda7-4a62-9810-539755b5196c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:59:49.797821 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.wsgi [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] HTTP exception thrown: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Request method failure captured: Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: request: GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 HTTP/1.1 Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept: application/json Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Accept-Encoding: identity Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Connection: close Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Length: 0 Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Content-Type: application/json Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Host: 10.222.0.20 Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: Openstack-System-Scope: None Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: User-Agent: python-urllib3/1.26.12 Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Auth-Token: gAAAAABjVpg5jLNWLF5zCjjI4FlCkKPXiNGun0bLWVlW1l03eq0VEV0srLt-gBBu2UYuJYVacFm9PAgAJ6xeqBJmnhQ9KBJcC190BRWk3_K7e0M6KBedkMJyL3rr93a4LtB0D5kPDEroFwxkt9w9KBuBwReIL2vagYWAw0zxAcmR8vHfuOQUpKw Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Id: None Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Domain-Name: None Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Identity-Status: Confirmed Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Is-Admin-Project: True Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Id: default Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Domain-Name: Default Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Project-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Role: member,reader Oct 24 13:59:49.799403 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Roles: member,reader Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5db8c3fdabf94498948055239da40ca0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5db8c3fdabf94498948055239da40ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}] Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Id: 5db8c3fdabf94498948055239da40ca0 Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-Tenant-Name: tempest-TestVolumeBootPattern-844646618 Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Id: default Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Domain-Name: Default Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Id: 568d031158744101a6bb339e51149ed2 Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: X-User-Name: tempest-TestVolumeBootPattern-844646618-project Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: method: > Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: exception: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.801708 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: action_args: {'id': '96cda293-d706-482f-acba-625c087884e9'} Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: {{(pid=125457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:59:49.802918 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. Oct 24 13:59:49.804525 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: ERROR nova.api.openstack.wsgi Oct 24 13:59:49.806207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: DEBUG nova.api.openstack.wsgi [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Returning 404 to user: Instance 96cda293-d706-482f-acba-625c087884e9 could not be found. {{(pid=125457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:59:49.806207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: INFO nova.api.openstack.requestlog [None req-74f153b6-eff5-48ac-b7b0-997e37036f39 tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9" status: 404 len: 111 microversion: 2.1 time: 0.032437 Oct 24 13:59:49.806207 dv-cinder-862490-2-iscsi devstack@n-api.service[125457]: [pid: 125457|app: 0|req: 666/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 24 13:59:49 2022] GET /compute/v2.1/servers/96cda293-d706-482f-acba-625c087884e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:59:51.097787 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: DEBUG nova.api.openstack.wsgi [None req-6c76dd73-9bef-417d-a07e-5fb5727019cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] Calling method '.version_select at 0x7f8dc60d70d0>' {{(pid=125456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:59:51.123591 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: INFO nova.api.openstack.requestlog [None req-6c76dd73-9bef-417d-a07e-5fb5727019cc tempest-TestVolumeBootPattern-844646618 tempest-TestVolumeBootPattern-844646618-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-519842543" status: 202 len: 0 microversion: 2.1 time: 0.030286 Oct 24 13:59:51.124174 dv-cinder-862490-2-iscsi devstack@n-api.service[125456]: [pid: 125456|app: 0|req: 671/1337] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 24 13:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-519842543 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)